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(54) OPTICAL DISC FOR RECORDING HIGH RESOLUTION AND NORMAL IMAGE, OPTICAL DISC 
PLAYER, OPTICAL DISC RECORDER, AND PLAYBACK CONTROL INFORMATION 
GENERATOR 



<57) The present invention has an objective o1 leal- 
izing compatibility ot an optical disk having a high reso- 
lution video signal recorded thereon and a system lor 
reproducing the optical disk, with a conventional system 
for producing a standard resolution video signal. A high 
resolution video signal is divided by video division 
means into a main signal and a sub signal, and the main 
signal and the sub signal are MPEG-encoded. The 
stream o1 the main signal and the stream ot the sub sig- 
nal are divided into 1 GOP or more of frames First inter- 
leave blocks 54 each including l GOP oi more of the 
stream of the main signal and second interleave blocks 
55 each including i GOP or more o1 the stream o1 the 
sub signal are recorded on an optica! disk 1 . A high res- 
olution reproduction apparatus r^roduces both the first 
and second interleave blocks to obtain a high resolution 
video output. A non-high quality picture reproduction 
apparatus lepioduces only the first or second interleave 
blocks to obtain a standard resolution video output. 
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Descriplion 
TECHNICAL FIELD 

(0001] The pieseni invention lelales. lo an optical 
disk having high quality picluie oi standaid picture 
lecoided iheieon. and a lecoiding and lepioduction 
appaialus lot such an optical di&K 

eACKGROUND ART 

[0002] For an optical dish having high quality picture 
I ecorded theieon and a lepi eduction appaiatus lor such 
an optical disk, systems lefeiied io as 480P and 720P 
foi lecoiding piogiessive data have oonventionally been 
studied. A conventionally Known leptoduction control 
system lor an optical disk uses one MPEG decodei. 
[0003] First, a lirst problem o1 the conventional sys- 
tem will be described. When a conventional optical disk 
for high quality picture recording leproduced by a 
standard repi eduction appaiatus. noimal pictures can- 
not be output. The optical disk tor high quality picture 
recording can only be reproduced by a high quality pic- 
tuie reproduction apparatus Accordingly, there is a 
need to produce two types o1 optical disks having the 
same contents. In other words, the conventional optical 
disk lor high quality picture recording is not compatible 
with a standard video reproduction apparatus. Next, 
objectives o1 the present invention will be described. A 
lirst objective o1 the present invention is for providing a 
optical disk for high quality picture recording compatible 
with the standard video reproduction apparatus and a 
reproduction system for such an optical disk. 
[0004] The compatibility herein can be defined as 
the relationship between the conventional monaural 
records and stereo records. That is, a novel 3D optical 
disk or high resolution optical disk according to the 
present invention is output with a standard resolution by 
the existing reproduction apparatus tor DVD or the like, 
and output with a high resolution by a novel reproduc- 
tion apparatus according to the present invention. 
^0005] Then, a second problem ot the conventional 
system is regarding a reproduction control system. By 
the conventional reproduction control system, one 
stream is reproduced using one decooer. Accordingly, 
in order to connect two streams of a high lesolution sig- 
nal seamlessly, i.e., without stopping the movement of 
the video, a complicated system is required. A secorxi 
objective of the present invention is for providing a 
reproduction control for connecting a plurality of 
streams seamlessly by a simple procedure. 

DISCLOSURE OF INVENTION 

10006] An optical disk reproduction apparatus 
according to the present invention is for reproducing a 
signal recorded on an optical disk. The optical disk has. 
recorded thereon at least a first video stream repre- 



senting a low tiequency component of the video signal 
and a second video stieam representing at least a high 
iiequency comj^onent o1 the video signal, the first video 
stieam includes a pluialily of first interleave units and 
the seconc video stieam includes a plurality of second 
intei leave units, each ot the plurality of first interteave 
units includes ml GOPs (where ml is an integer ot i or 
greaiei). each ot the plurality of second interleave units 
includes m? GOPs (wheie m2 is an integer of i or 

7C gi eater) The optical disk reproduction apparatus 
includes, a lepioOuction section lor reproducing the f irst 
video stieam and the second video stieam recorded on 
the optical disk, a division section for dividing the repro- 
duced fust video stieam into the plurality of first inter - 

It leave units and for dividing the reproduced second 
video stream into the plurality of second interleave 
units; a decoding section for decoding the plurality ot 
III St interleave units to generate a first reproduction sig- 
nal lepiesenting the low frequency component of the 

20 video signal and for decoding the plurality of second 
interleave units to generate a second reproduction sig- 
nal lepiesenting at least the high frequency <x>mponent 
of the video signal; a synthesis section for synthesizing 
the first reproduction signal and the secorxJ reproduc- 

P£ tion signal to generate the video signal; arKJ an output 
section for selectively outputting at least one of the first 
reproduction signal, the second reproduction signal, 
and the video signal. The above<le5cribed objective is 
achieved by this. 

30 (0007] The plurality of first interleave vnWs may be 
each coriesponded to first time information relating to 
reproduction time, and the plurality of second interleave 
units may be each corresponded to second time infor- 
mation relating to reproduction time. 

35 [0008] The opttcal disk reproduction apparatus may 
further include a reference time signal generation sec- 
tion for generating a reference time signal; a first repro- 
duction control section tor controlling the reproduction 
time o1 the first reproduction signal in accordance with 

<c the ditierence between the refererKe time signal and 
the first time information; a second reproduction control 
section for controlling the reproduction time of the sec- 
ond leproduction signal in accordance with the differ- 
ence between the reference time signal and the second 

<£ time information; and an adjusting section for adjusting 
the reference time signal so that the retererKe tinne sig- 
nal supplied to the first reproduction control section and 
the reference sicrial supplied to the second reproduc- 
tion control section represent substantially the same 

so time. 

[0009] The adjusting section may adjust the refer- 
ence time signal based on audio reproduction time 
informaiion representing the time to reproduce an audio 
signal which is to be output in synchronization with the 
£f video signal. 

[0010] The adjusting section may adjust the refer- 
ence time signal based on at least one of first video 
leproduction time information representing the time to 
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lepMOduce the iiist lepioduciior* signal and second 
video iep»oduclion lime mloimatton lepiesenting the 
lime to lepioduce the second leptoduclion signal. 
(0011] The lirst lepioduction conliol section may 
conliol the lepioduclion time o1 the lust leptoduction 
signal by skipping a liame ol the tusi lepioduclion sig- 
nal oi by lepjoducing a Irame ol the Inst lepioduction 
signal m lepetilion. The second lepioduction control 
section may contiol the l epioduciion time ol the second 
repioduclion signal by skipping a fiame of the second 
reproduction signal oi by repioduang a Irame ol the 
second lepioduciion signal in lepeiiiion. 
[0012] At least one ot the tlist time infor mation and 
the second time inloimation may include at least one of 
a PTS. a DTS and an SCR. 

[0013] The tirst lepioduction signal may conespond 
to a first pixel number, and the second t eproduction sig- 
nal may conespond to a second pixel number, which is 
larger than the first pixel number. The synthesis section 
may include a converlei for converting the first repro- 
duction signal into a conversion signal conesponding to 
the second pixel number. The video signal may be 
obtained by synthesizing the conversion signal and the 
second reproduction signal. 

[0014] The optical disk further may have, recorded 
thereon, an identifier representing the first pixel number 
conesponding to the first repoduction signal, and the 
converter may convert the first reproduction signal into 
the conversion signal in accordance with the identifier. 
[0015] The optical disk further may have, recorded 
thereon, an identifier representing the first pixel number 
corresponding to the first reproduction signal. The opti- 
cal disk reproduction apparatus may further include a 
rotation control section for controlling the rotation of the 
optical disk. The rotation control section may control the 
rotation of the optical disk in accordance wWh the identi- 
fier. 

[0016] The optical disk further may have, recorded 
thereon, an identrtiei representing that the video signal 
is obtained by encoding a progr essive video signal of 24 
frames to 30 frames per second. The output section 
may include a converter foi converting at least one of 
the first reproduction signal, the second repioduction 
signal, and the video signal into a frame signal. The out- 
put section may output the progressive video signal of 
60 frames per second by outputting the frame signal in 
an overlapping mannei. 

[001 7] The optical disk reproduction apparatus may 
further include a buffer memory section for storing the 
plurality of iirsi interleave units and the plurality of sec- 
ond interleave units The buffer memory section may 
have a capacity which is equal to or greater than an 
amount of data of the GOP or GCPs included in the sec- 
ond interleave units. 

[0018] The buffet memory section may have a 
capacity which is l f^lE or greater. 
[0019] An optical disk according to the present 
invention include, recorded thereon, at least a first video 



siieam lepiesentmg a low frequency component of the 
video signal and a second video stream representing at 
least a high fiequency component of the video signal, 
wheiem: the fust video stream includes a plurality of first 
I interleave units, the second video stream includes a 
plurality of second interleave units, each of the plurality 
of first interleave units includes ml GOPs (where mi is 
an integer of i oi gi eater), and each of the plurality of 
second interleave units includes m2 GOPs (where m2 is 
an integer of i or greater). The above-described objec- 
tive is acfiieved by this. 

10020] The plurality Of first interleave units and the 
plurality of second inta leave units may be structured so 
that lepioduaion time of one of the plurality of first inter- 
im leave units is substantially equal to reproduction time of 
one of the plurality of second interleave units, the one of 
the pluiality of second interleave units corresponding to 
the one of the plurality ot first interleave units. 
[0021] An optical disk recording apparatus accord 
po ing to the present invention includes a dividing section 
for dividing a video signal into a first video signal repre- 
senting a low frequency component of the video signal 
and a second video signal representing at least a high 
frequency component of the video signal; an encoding 
section for generating a first video stream by encoding 
the first video signal and for generating a second video 
stream by encoding the second video signals wherein: 
the first video stream includes a plurality of first inter- 
leave units, the second video stream includes a plurality 
30 of second interleave units, each of the plurality ol first 
interleave units includes ml GOPs (where ml is an 
integer of i or greater), and each of the plurality of sec- 
ond interleave units includes nri2 GOPs (where m2 is an 
integer of 1 or greater); a selection output section for 
3c selectively outputting the plurality of first interleave units 
included in the first video stream and the plurality of sec- 
ond interleave units included in the second video 
stream: and a recording section tor recording the signal 
output from the selection output section on an optical 
40 disk. The above-described objective is achieved toy this. 
[0022] The division section may include a decoder 
for decoding the first video stream and a differential cal- 
culator for calculating a differential between the video 
signal end the signal output from the decoder, and may 
<£ output the signal output from the differential calculator 
as the second video signal. 

[0023] The division section may further include a 
first converter for converting the video signal into a first 
conversion signal corresponding to a second pixel 

BO number which is smaller than a first pixel number corre- 
sponding to the video signal, artd a second converter for 
converting the signal output from the -decoder into a 
second conversion signal corresponding to the first pixel 
number which is larger than the second pixel number 

£5 corresponding to the signal ou4>ut from the decoder. 
The division section may output the first conversion sig- 
nal as the first video signal. The differentia! calculator 
may calculate the differential between the video signal 
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and the second conversion signal 
'{0024] The recording section may turthei lecoid on 
the optical disk an identiliei repiesentmg thai ihe sec- 
ond video signal is output from the dilfeieniial calcula- 
4oi. 

(0025] The recording section may iurthei lecord on 
the optical disk an identilier lepiesentmg the tiist pixel 
number corresponding to the video signal 
(0026] The recording section nnay furthe» lecord on 
the optical disk an identHiei representing the second 
pixel number corresponding to the lirsi video signal 
{0027] An optical disk recording appaiatus accoid- 
ing to the present invention includes an input section toi 
receiving an encoded first video stream conesponding 
to a first pixel number and an encoded second video 
stream corresponding to a second pixel numbei which 
is different from the first pixel numbei. wheieih the first 
video stream includes a plurality of first interleave units, 
the second video stream includes a plurality of second 
interleave units, each of the plurality of first interleave 
units includes ml GOPs (where ml is an integer of 1 oi 
greater), and each of the plurality o1 second interleave 
units includes m2 GOPs (where m2 is an integer of 1 oi 
greater): a selection output section for selectively out- 
putting the plurality of first interleave units included in 
the first video stream and the plurality of second inter- 
leave units included in the second video stream: and a 
recording section for recording the signal output from 
the selection output section on an optical disk. The 
crix)ve'described objective is achieved by this. 
f0028] An optical disk reproduction apparatus 
according to the present invention is for reproducing a 
'Signal recorded on an optical disk. The optical disk has. 
recorded thereon, at least a first video stream including 
a plurality of first GOPs and a second video stream 
including a plurality of second GOPs. each of the plural- 
ity of first GOPs includes a plurality of pictures, and 
each of the plurality of second GOPs includes a plurality 
of pictures. The optical disk reproduction apparatus 
includes a reproduction section tor reproducing the first 
video stream and the second video stream recorded on 
the optical disk; a decoding secticn for decoding the first 
video stream and the second video stream, and an out- 
put section for selectively outputting the decoded first 
video stream and the decoded second video stream in 
accordance with reproduction control information. The 
reproduction control information indicates that after a 
first picture included in a final first GOP among the plu- 
rality of first GOPs included in the first video stream is 
reoroduced. a second picture included in a leading sec- 
GOP among the plurality of second GOPs included 
in me second video stream is reproduced, the second 
picture being different from a leading picture of the lead- 
ing second GOP The above-described objective is 
achieved by this. 

[0029] The decoding section may start decoding 
the second video stream so that the decoding of the 
second picture has been completed when the reproduc- 



tion of the first picture is completed 
10030] The repioduclion control mloimation may 
include information tsi tepiesenting a position of the 
first piaure. information ts2 representing a position of 

t the second pictufe. and information tsG representing a 
position of the leading pictuie of the leading second 
GOP. The decoding section may find a decoding start 
position ta in accordance with expiession 
ta=tsl -(ts2-tsG) . and starts decoding the second video 

ir stream based on the decoding start position ta 

10031] The reproduction control infoimation may 
include timing mtoimation representing the timing to 
start decoding the leading second GOP so that i epro- 
duction completion time ol the first picture matches the 

75 repioduction start time of the second pictuie. The 
decoding section may start decoding the second video 
stream based on the timing information. 
{0032] The decoding section may omit -decoding of 
a picture which is not necessary for decoding pictures 

PC from the leading pictuie of the leading second GOP to 
the second picture. 

(0033] The picture which is not necessary may be a 
8 picture. 

(0034] The optical disk reproduction apparatus may 
P5 further include a buffer memory section for storing the 
f irst video stream and the second video stream, and the 
buffer memory section has a<:apacity which is equal to 
or greater than an amount of data of 1 GOP 
[003S] The optical disk has the reproduction control 
3D information recorded thereon. The repioduction section 
may reproduce the reproduction control information 
recorded on the optical disk. 

(0036] The optical disk may further have, recorded 
thereon, an identrtier representing whether oi not the 

5£ reproduction control information is recorded on the opti- 
cal disk, and when the identifier represents that the 
reproduction control information is recorded on the opti- 
cal disk, the reproduction section may reproduce the 
reproduction control information recorded on the optical 

40 disk. 

(0037] In a fast reproduction mode, when the sec- 
ond picture is not an I picture, the ou^ut section may 
prohibit an I picture included in the leading second GOP 
from being output. 
^5 (0038] The ou^ut section may prohibit a part of the 
I picture included in the leading second GOP from being 
output based on 1 picture reproduction prohibition infor- 
mation. 

(0039] A reproduction control information oenera- 
56 tion apparatus according to the present invention 
includes an input section for receiving a first video 
stream including a plurality of first GOPs and a second 
video stream including a plurality of second GOPs: and 
a generation section for generating reproduction control 
5f information which represents that after a first picture 
included in a final first GOP among the plurality of first 
GOFs included in the first video stream is reproduced, a 
second pictuie mcluded in a leading second GOP 



4 



EP 1 on 268 A1 



8 



among the pfuiality oi second GOPs mciuded m the 
second video stream is lepioduced. the second pictuie 
being diflerent liom a leading pictui e oi the leading sec- 
ond GOP. The above-desciibed objective is achieved by 
this- 

(0040] The lepioduction conliol tnloimaticn may 
include inloimation lepiesenting the numbei ot pictuies 
from the leading picture oi the leading second GOP to 
the second picture. 

[0041] The reproduction contiol inloimation may 
include mtormation lepiesentmg the time to lepioduce 
the leading picture oi the leading second GOP and the 
time to reproduce the second piauie oi the leading sec- 
ond GOP 

[0042] The leprodudion contioI inloimation may 
include tinning infoimation lepresenting the timing to 
Start decoding the leading second GOP so that lepro- 
duction completion time ot the first picture matches the 
reproduction start time of the second picture. 
[0043] The timing information may repiesent the 
timing to start decoding the leading second GOP when 
a picture which is not necessary for decoding pictures 
from the leading picture of the leading second GOP to 
the second picture is not decoded. 
[0044] The picture which is not necessary may be a 
B picture. 

[0045] An optical disk recording apparatus accord- 
ing to the present invention includes a generation sec- 
tion for generating reproduction control iniormation; and 
a recording section for recording the reproduction con- 
trol information on an optical disk having, recorded ther- 
eon, a first video stream including a plurality of first 
GOPs and a second video stream including a plurality of 
second GOPs. The reproduction control inloimation 
represents that after a first picture included in a final first 
GOP among the plurality of first GOPs included in the 
first video stream is reproduced, a second picture 
included in a leading second GOP among the plurality 
of second GOPs included in the second video stream is 
reproduced, the second picture being difletent from a 
leading picture of the leading second GOP. The above- 
described objective is achieved by this. 
[0046] An optical disk recording apparatus accord- 
ing to the present invention includes an editing section 
for editing a first video stream including a plurality of first 
GOPs and a second video stream including a plurality of 
second GOPs so that at least one picture unnecessary 
for reproduction is deleted in accordance with the repro- 
duction control information; and a recording section for 
recording the edited first video stream and the edited 
second video stream on an optical disk. The reproduc- 
tion control information represents that after a first pic- 
ture included in a final first GOP among the plurality of 
first GOPs included in the first video stream is repro- 
duced, a second picture included in a leading second 
GOP among the plurality of second GOPs included in 
the second video stream is reproduced, the second pic- 
ture being diflerent from a leading picture of the leading 



second GOP The above-desciibed objective is 
achieved by ihis 

[0047] The at least one picture unnecessary tor 
lepioduction may include a picture, of the first video 

s stream, after the first picture, and a picture, ol the sec- 
orxJ video stream, beiore the secorxi picture 
[0048] The at least one picture unnecessary for 
reproduction may further include a picture which is not 
necessary for decoding pictures from the leading pic- 

jf' ture of the leading second GOP in the second video 
stream until the second picture. 

[0049] The at least one picture unnecessary tor 
reproduction may be a B piaure. 

[0050] The recording section may record the edited 
J 5. til St video stream and the edited second video stream in 
continuous i egions oi the optical disk. 
[0051 ] The recording section may r ecord the repro- 
duction control inf or mation on the optical disk. 
[0052] The recording section may record the repro- 
po duction control information on a medium other than the 
optical disk. 

BRIEF DESCRIPTION OF DRAWINGS 
25 [0053] 

Figure 1 is a block diagram of a 720P/480P hierar- 
chical recording apparatus in one example accord- 
ing to the present invention. 

30 Figure 2 is a block diagram of a 480i/480P/720P 

(60) reproduction apparatus in one example 
according to the present invention. 
Figure 3 is a block diagram of a 480P/720P (24/60) 
reproduction apparatus in one example according 

35 to the present invention. 

Figure 4 is a block diagram of a reproduction appa- 
ratus (720P output) of horizontal direction synthesis 
system in one example according to the present 
invention. 

40 Figure 5 is a block diagram of a three hierarchical 
layer optical disk recording apparatus in one exam- 
ple according to the present invention. 
Figure 6 is a block diagram of a recording and 
reproduction apparatus of a frame-based repr oduc- 

<t tion conti ol system in one example according to the 
present invention. . 

Figure 7 shows a process for recording steams by a 
recording apparatus of a reproduction control infor- 
mation recording system in one example according 

50 to the present invention. 

Figure 8 is a diagram comparing repr oduction of an 
optical disk in one example according to the 
present invention by an existing reproduction appa- 
ratus arKf by a reproduction apparatus according to 

££ the present invention. 

Figure 9 is a graph illustrating the leiationship 
between the lecordinc time period and the capacity 
of an optical disk in one example according to the 
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piesent invention 
Figuie 10 IS a block diagiam ol h hietaichical lepio* 
duclion ap)paiatus ol a 480P lepioduction mode m 
one example accoidmg lo ihe pies.ent invention 
Figure 11 is a table showing a data stiuctuie ot e 
lepioduclion coniro! intoimaiion m one example 
according lo ttie pi eseni invention 
Figuie 12 IS a diagram illustiating a piocess loi 
lecoidmg a pluiality ol stieams. by a lecording 
appaialus m one example accoidmo to the present io 
invention and a piocess loi repioducmg the plurality 
ot sti earns by a reproduction appaiatus in one 
example accoiding to the piesent invention 
Figure 13 IS a flowchart illusualing lepioduction 
contiol ol two sti earns peitoimed based on the i5 
lepioduction contiol infoimation by a leptoduction 
apparatus m one example accoidmg to the piesent 
invention. 

Figure 14 IS a table showing a data structure of the 
reproduction control information when the time 20 
stamps of the streams aie continuous in one exam- 
ple according to the present invention. 
Figure 15 is a diagram illustrating a process for 
recording and reproduction performed by a record- 
ing and reproduction apparatus in one example 25 
according to the present invention. 
Figure 16 is a flowchart illustrating a piocess tor 
editing and generation of reproduction control infor- 
mation performed by a recording apparatus in one 
example according to the present invention. 50 
Figure 17 is a table showing a data structure of a 
picture identifier, representing information including 
resolution, of management information data in one 
example according to the present invention 
Figure 18 is a block diagram showing an MPEG 3£ 
decoder o^ a reproduction apparatus ol a ditterent 
system in one example according to the present 
invention; 

Figure 19 is a diagram illustrating the principle of 
multiple angle picture data division multiplex 40 
recording system in one example according to the 
present invention. 

Figure 20 is a diagram illustiating a method for 
recording horizontal and vertical interpolation infor- 
mation in interleave blocks after being divided in t5 
one example according to the piesent invention. 
Figure 21 is a view illustrating the principle of an 
f^ADM system for dividing a signal into two in a hor- 
izontal, direction in one example according to the 
present invention. so 
Figure 22 is a diagram illustrating picture synthesis 
control performed by a reproduction apparatus in 
one example according to the piesent invention. 
Figure 23 is a diagram showing signal arrangement 
for outputting a piogressive signal, an NTSC signal 5f 
and a HDTV signal in one example according tc the 
present invention. 

Figure 24 is a timing diagram of lepioduction of pro- 
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giessive. 3D and wide signals with respect to the 
data amount in butler in one example according to 

the piesent invention 

Figuie 25 is a block diagram of a reproduction 
appaiatus m one example according to the present 
invention m an mteilace video signal output mode 
Figuie 26 is a flowchart illustratir^ a method for 
peiioiming AV synchionization ol a first decoder 
and a second decodei in one example according to 
the present invention. 

higuie 27 IS a flowchart illustrating a method toi 
conti oiling two butter sections in one example 
according to the present invention. 
Figuie 28 is a timing diagram showing a data 
stieam which is lepioduced and output attei pioc- 
essed with buffering and decoding by the decodei 
in one example accoiding to the present invention. 
Figuie 29 is a flowchart showing a detailed process 
foi lepi oducing a program chain group by a system 
control section Ml 9 in one example according lo 
the present invention. 

Figure 30 is a block diagram showing a structure of 
a part of an AV synchronization control 12-10. the 
part perfoiming AV synchronization, in one exam- 
ple accoiding to the present invention. 
Figure 31 is a trfock diagram of a data decoding 
section in one example accoiding to the present 
invention. 

Figure 32 shows a signal format of a picture identi* 
f iei in one example according to the present inven- 
tiori. 

Figure 33 is a flowchart illustrating a process for 
STC switching foi seamless connection in one 
example according to the present invention. 
Figure 34 is a view illustrating processing of a hori- 
zontal filter circuit in one example according to the 
present invention. 

Figure 35 is a block diagram showing a structure of 
an optical disk reproduction apparatus in one 
example according to the present invention. 
Figuie 36 is a structural view of a video decoder in 
one example according to the present invention. 
Figur e 37 shows a data structure of an optical disk 
in one example accor ding to the present invention. 
Figure 38 is a timing diagram of video reproduction 
in one example according to the pcesent invention. 
Figure 39 is a block diagram showing a structure of 
an optical disk reproduction apparatus in one 
example accordir>Q to thepresent invention. 
Figur e 40 is a structural view of an audio decoder in 
one exanple according to the present invention. 
Figure 41 shows a data structure of an optical disk 
in one example according to the present invention. 
Figure 42 is a timing diagram of audio and video 
reproduction in one example accordir>g to the 
present invention. 

Figuie 43 shows an optical disk reproduction appa- 
iatus rn one example according to the present 
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invention. 

Figure 44 is a stiucluia! view oi a video decodei m 
one example accoiding to the piesent invention 
Figure 45 is a timing diagiam of video lepioduction 
in one example accoiding to the piesent invention 
Figure 46 is a block diagiam showing a stiuctuie oi 
an optical disk lepioduction appaiatus m one 
example according to the ptesent invention. 
Figure 47 is a structural view oi a video decodei in 
one example accoiding to the piesent invention. 
Figure 48 is a stiuciuial view oi a video decodei in 
one example according to the piesent invention. 
Figure 49 is a sliuctuial view oi a video decodei in 
one example accoiding to the piesent invention. 
Figure 50 is a block diagiam showing a sliuctuie oi 
an optical disk lepioduction ap>paiatus in one 
example according to the piesent invention. 
Figure 51 is a structural view oi an audio decodei in 
one example according to the present invention. 
Figure 52 shows a data structuie of an optical disk 
in one example according to the present invention 
Figure 53 is a timing diagram oi audio and video 
reproduction in one example according to the 
present invention. 

Figure 54 is a timing diagram oi operation trequen- 
cies oi audio reproduction in one example accord- 
ing to the present invention. 
Figure 55 is a timing diagram oi operation frequen- 
cies of audio reproduction in one example accord- 
ing to the present invention. 

Figure 56 is a diagram illustrating a flow oi a stream 
in a reproduction apparatus in one example accord- 
ing to the present invention. 

Figure 57 is a flowchart illustrating a process for 
MPEG encoding, editing/reproduction control infor- 
mation generation, and reproduction contiol pei- 
formed by a recording and reproduction apparatus 
in one example according to the present invention. 
Figure 58 is a block diagram o1 a recording and 
reproduction apparatus oi a frame-based reproduc- 
tion control system in one example according to the 
present invention. 

Figure 59 is a diagram illustrating a process toi 

deleting an unnecessary frame in one example 

according to the present invention. 

Figure 60 is a block diagram of a reproduction 

apparatus of a mutual authentication system and a 

TV monitor in one example according to the present 

invention. 

:-:.ESl MODE FOR CARRYING OUT THE INVENTION 

[0054] Hereinafter, the present invention will be 
described by way of examples with reference to draw- 
ings. 



(Example i) 

{720P/480P hierarchical lecoiding and i ejDi oduction 
system) 

|0055]> With lelerence to Figure 1 . a specilic hieiai- 
chical recording appaiatus for handling two hieiaichical 
layers oi 720P and 480P will be described. Latei. a 
method loi recording a HDTV signal in a hieiarchical 
w mannei in the state wheie the HDTV signal is divided 
into a plurality oi signals will be descnbed. with letei- 
ence to Figure 20. 

(00S6] In the case oi a movie signal, specilically. an 
otiginal 720P video signal of 60 liames pei second, the 

7£ signal is input and then has extia frames deleted by a 3* 
2 pull-down section 746. As a lesult. a 720P (24 P) sig- 
nal 703 oi 24 frames pei second is obtained. In the case 
of a normal 60P video signal, the 3-2 pull-down section 
is bypassed. Herein. 60P relers to 60 frames per sec- 

20 ond. The 720P video signal 703 having 1280 >. 720 pix- 
els is processed by a 720P/480P down-converter 704 
as follows. First, the number of vertical lines is reduced 
to 720 > 2/3 = 480 by a vertical filter 705. Then, the 
number of pixels is i educed to 1280 a 9/16 = 720 pixels 

25 by a horizontal filter 706. Thus, the 720P video signal 
703 is converted into a 480P video signal 707 having 
720 X 480 pixels. Such a low resolution 480P video sig- 
nal is encoded by an MPEG encoder 708 for 480P into 
a compression MPEG signal. Then, the compression 

30 MPEG signal is decoded back into a 480P video signal 
710 by an MPEG decoder 709. This signal is enlarged 
to 3/2 times and 16/9 times respectively by a vertical fil- 
ter 712 and a horizontal filter 713 in a 480P/720P up- 
converter 71 1 . and thus is converted into a 720P high 

35 resolution video signal 714. The original 720P video sig- 
nal 703 and the 720P video signal 714 obtained by 
MPEG encoding and decoding are differential-calcu- 
lated by a calculation circuit 715 in a differential signal 
processing 720. and thus differential information 716 is 

<o obtained. 

[0057] The differential information 71 6 is encoded 
by a second MPEG encoder 717 for 720P into a GOP- 
based video signal including an intraframe (i picture) 
and a differential frame (P or-B). This signal is divided by 

4f multiplex means 71 9 into GOP-based second interleave 
blocks 718a and 718b including iGOP to nGOP An 
MPEG stream of a basic signal encoded by the first 
MPEG encoder 708 for 480F in a basic signal process- 
ing section 721 is made into a 480P GOP-based MPEG 

so stream and then divided by the multiplex means 719 
into first interleave blocks 722a and 722b. The first inter- 
leave blocks 722a and 722b are interleaved into the 
second interleave blocks 71 8a and 718b; i.e.. the first 
interleave blocks 722a and 722b and the second inter- 

5f leave t>locks 718a and 7i8b are alternately arranged. 
The resultant signal is tecorded on a disk 724 such as a 
DVD or the like by recording means 723. Also recorded 
at this point are a hieiarchical recording identifier 725 
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iixlicaling the siail pomi and ihe teiminalion pomi and 
specilied mtei leave block lepioduclion piohibilion irrtoi- 
malion 726 loi piohibilmg ttie secx^nd mleiieave blocks 
718a and 718b including ihe ditleieniial mioimation 
liom being lepioduced by ihe con*/eniional lepi eduction 
appaialus The idenliliei and mloimalion aie lecdded 
in overati management mioimaiion 224 and each o1 
VOBs as shown m Figuie 23 

[0058] When the disk 724 is lepioduced by the 
existing lepioduclion apparatus based on the DVD 
standards as shown m Piguie 8. the intei leave blocks 
722a and 722b aie legarded as a tnst angle and lepro- 
duced. The lepioduction signal is decoded by MPEG 
data 727. and thus NTSC oi 480P (24 tiames) video 
signal is lepioduced As shown in Figuie 23. the speci- 
fied interleave block lepioduction piohibition inioima- 
tion 726 loi piohibiling specilied interleave blocks 
including the dit1e»entiai intoi malion Irom being repro- 
duced, lor example, an angle switching prohibition flag 
is recorded Accordingly, even i1 the user inadvertently 
operates the lepioduction apparatus, leproduction o1 a 
second angle, i.e.. the second interleave unit is prohib- 
ited. In other words, the differential inlormation lor 720P 
is automatically prevented from being reproduced by 
the existing DVD reproduction apparatus When the dil- 
teienlial inlormation for 720F is reproduced in error, 
malfunction occurs since this signal cannot be normally 
reproduced by a first MPEG decoder for 480i ot the 
existing reproduction apparatus. This type of trouble is 
avoided by the present invention. In this case, informa- 
tion on connection to the second interleave blocks may 
be intentionally excluded from the management infor- 
mation 224. which is referred to as the navigation infor- 
mation in the DVD standards. 

{0059] The above-oescribed effect is also useful 
when a 720P signal itself is recorded in the second 
interleave blocks. In this case, the 720P signal is directly 
input to the MPEG encodei 717 as shown by the arrow 
indicated with *' " in Figure 1 . 

[0060] In this mannei. when the disk 724 is repro- 
duced by the existing DVD reproduction apparatus, a 
video signal is reproduced at the quality equivalent to 
NTSC. which is obtained by lepioducing an existing 
DVD disk; and furthermore erroneous reproduction of 
information which cannot be normally reproduced by 
the existing DVD lepioduction apparatus, such as a dif- 
ferential signal oi a 720P signal, is prevented. Thus, 
bidirectional compatibility is realiaed. 
[0061] A 480P signal itself may be recorded in the 
second interleave blocks instead of the 720P signal. In 
this case, the first interleave blocks are reproduced and 
thus a 480i (NTSC) signal is output by the conventional 
reproduction apparatus By a leproduction apparatus 
according to the present invention, a 480i signal from 
the first interleave blocks oi a 480P signal from the sec- 
ond interleave blocks is leproduced. or both of them can 
be reproduced 

[0062] When a reproduction apparatus according to 



the piesent invention is used, a basic signal is lepio- 
duced fiom the fust interleave blocks 722a and 722b. 
which IS letened to as the first angle in the DVD stand- 
aids A diffeiential signal and a 720P signal are repro- 

£ duced fiom the second interleave, blocks 718a and 
718b. which IS leleiied to as the second angle in the 
DVD standards Piom the first angle, a 480P video sig- 
nal 729 IS output by an MPEG decoder 728 for 480P; 
and'tiom the second angle, a 720P video signal 731 oi 

10 a 720P signal as a diffeiential signal is reproduced by 
an MPEG decodei 730 foi 720P. These two video sig- 
nals having a dif tei ent number of pixels are synthesized 
by a synthesis section 732 or output as they are. and 
thus decoded into an oiiginal 720P video signal 733 to 

,5 be output. 

[0063] In this mannei. when the hierarchical record- 
ing disk 724 is lepioduced by the reproduction appara- 
tus accoiding to the piesent invention, a 720P video 
signal is output. Thus, a HDTV signal such as a 720P 

p6 signal can be recorded while compatibility with the con- 
ventional reproduction apparatus is maintained. 
[0064] When a 480P signal itself is recorded in the 
second interleave blocks, a 480P signal having a den- 
sity twice as high as that of an NTSC signal is repro- 

25 duced. 

[0065] With reference to Figure 3. a more specific 
operation of the repioduction<tesaibed with reference 
to Figuie 8 will be described. The blocks which have 
already been described will not be^Jescribed again. 

3c [0066] The disk 724 has a basic signal and a differ- 
ential signal recorded thereon alternately after t>eing 
divided on an nGOP-by-nGOP basis tiy the multiplex 
means 71 9 shown in Figure 1 and interleaved. This sig- 
nal is divided into the f irst interleave block 722a and the 

35 second interleave block 718a. i.e.. the basic signal and 
the differential signal, by a division section 734 of the 
leproduction apparatus shown in Figure 3. Then, the 
basic signal end the differential signal are stored in a 
first butter memory 735 arxJ a secorKf -buffer memory 

<c 736 respectively Then, respective time information is 
extracted from a time information extraction section 
793. A VTS synchronization section 780 sets first -basic 
time information and second basic time information in 
the first decoder 728 and the second decoder 730 so 

45 that the two signals aie in synchronization with each 
other. Thus, output signals from the two decoders are 
synchronized. In this case, when the hierarchical 
recording identifier 725 is detected, an identification 
information processing section 745 recognizes that a 

5c filst reproduction signal which is the decoded signal of 
the first stream is a basic signal havir^g a smaller 
number of pixels and that a second reproduction signal 
which is the decoded signal of the secorxj stream is a 
diffeiential signal having a larger number of pixels and 

55 having the differential information from the basic sigr«l. 
Thus, the identification information processing section 
745 give the synthesis section 732 an instruction 
legarding an up-converter 738 and an instruction of 
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addilton 

10067] The MPEG decodei 728 ioi 480P and the 
MPEG decodei 730 lespeclively decode the signals 
into a 4&0P (24) signal a»xi a 720 (24 irames) signal. 
The decoded signals have 24 tiames/sec. oi 30 r 
liames/sec The signals aie piocessed by 2-3 convei- 
sion sections 737a and 737b so as to output the same 
liame twice, and thus a 4 BOP signal 729 o1 60 
liames/sec. and a 720P signal 731 having the ditleren- 
lial inloi mation are obtained. The 480P signal 729 is up- 
converted into a 720P signal 739 by the 480P/720P up- 
converiei 738 and added to the 720P signal 731 having 
the ditterential inloimation by an addition section 740. 
and thus the oiiginal 720P video signal 733 is obtained. 
The addition section 740 calculates, lot example, as n 
shown in the figuie. Wheie the pixels o1 the respective 
signals are a and b. (a+b)/2 is perloi med to obtain the 
original 720P video signal 733. The calculation per- 
iof med by the synthesis section 732 may be different 
Irom (a-4 b)/2. po 
f0068] In this case, the MPEG decoding signals 
may be kept to have 24 tiames/sec. without being con- 
verted by the 2-3 conversion sections 737a and 737b to 
have 60 frames/sec. and after synthesis, converted to 
have 60 frames/sec. by a 2-3 conversion section 741 . In i^i: 
such a case, the amount o1 date o1 the video signal is 
advantageously reduced to halt, and the processing 
ability o1 the digital processing ciicuit can be leduced to 
hall. 

[0069] With reference to Figures 1 and 3. the 3c 
method tor recording and leproducing a 720P signal oi 
24 trames/sec. such as a movie signal in a hierarchical 
manner has been described. This method has signifi- 
cant advantages. The HDTV formal includes the lOBOi 
system and the 720P system As shown in Figure 9. a 55 
I080i signal (24 frames) used for movies can be 
recorded only for 90 minutes since a two-layer DVD has 
a capacity of 8.5 GB as indicated by curve 742a. 
[0070] By contrast, a 720P signal (24 frames) can 
be recorded tor 150 minutes as indicated by curve <o 
742b. A 460P signal (60 frames) can be recorded tor 
150 minutes as indicated by curve 742c. Disks for mov- 
ies are considered to be meaningless unless each has 
a recording capacity of 120 minutes or more. The 720P 
(24)/480P hierarchical recording disk has an effect that <r 
an HDTV movie title can be accommodated in one DVD. 
[0071] In the example shown in Figure 3. a 480P 
signal having the basic information of a 720P signal is 
recorded in the first interleave blocks, and the differen- 
tial information between the 720P and 480P signals is £^ 
recorded in the second interleave blocks. For a disk 
having a 720P signal as i1 is in the second interleave 
blocks is reproduced, the output from the second 
decoder 730 can be output as it is as shown by arrow 
indicated with in Figure 3. The determination to do ee. 
this is made by the identification information processing 
section 743 based on an identifier. In this case also, an 
effect equivalent to complete compatibility is obtained. 



1 his system has a lower recording efficiency but has the 
effect oi simplifying the processing circuit for i ecording 
and I eproduction and the effect of the conplete compat- 
ibility 

[0072] With reference to Figure 60. an example in 
which a decodei is mounted on a TV monrtor 798 will be 
described The basic operation is the same as that 
desci ibed with i efer ence to Figure 3. arxJ only the diffei - 
ent parts will be described. In a reproduction apparatus 
743a. a signal belore decoding is erKrypted by an 
enciyption encoder 795 usir^ an encryption key 799a 
and sent tiom a communication interface section 796a 
thiough a network 798 to a communication interface 
section 796b in the TV monitor 798. Before this opera- 
tion, mutual authentication sections 794a and 794b 
communicate to each other to authenticate each othei. 
This operation may be referred to as a fiandshake. In 
the case where mutual authentication is confirmed and 
thus both sides deternvne that the other side is proper, 
the mutual authentication sections 794a and 794b pro- 
vide the encryption encoder 795 and an encryption 
decoder 797 with the encryption keys 799a and 799b 
and also per mit the communication interface 796a and 
796b to communicate. Thus, encryption data is sent 
and received, and the keys of the encryption data are 
unlocked- Therefore, the first stream and the second 
stream are respectively sent to the first decoder 728 
and the second decoder 730. The determination to con- 
duct this processing is made by the identification infor- 
mation processing section 745 based on an identifier 
744 which is separately sent. When the first stream is of 
a 480P signal and the second stream is of a 720P differ- 
ential signal as described at)ove. up-conversion and 
synthesis calculation are performed, and a 720 P signal 
is output to a TV monitor 798a. When an identif ier indi- 
cating that the second stream is of a 480P differential 
signal is received, the two streams are synthesized to 
output a 480P signal. When an identifier indicating that 
the streams are of a 3D signal, a 3D signal is output and 
displayed on the TV monitor 798a. The 3D signal is 
obtained by time-based synthesis, where the first 
stream is set for the left eye and the second stream is 
set for the right eye. 

[0073] According to this system, even when two 
streams are encrypted, the streams are processed, for 
exarnple, synthesized by the TV monitor using the iden- 
tic iei 744. Thus, the original picture can be obtained 
without violating the copyright protection secured by the 
enciyption. 

[0074] Next, with refererK:e to Figure 10. an opera- 
tion for reproducing a disk 724a having a 480P (60 
fiames/sec.) recorded thereon by the reproduction 
apparatus according to the present invention will be 
described Common parts as those in Figure 3 will not 
be described. 
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(Sum and difterence system - Figuie 19) 

40075] With leteience 1o Figuie 19 the concepl o* 
the sum and ditieience syslem v^ill be descitoed. This, 
system is refeired to as multiple angle video data divi- 
sion multiplex syslem (MADM) since a video signal is 
<jivided into vertical ot horizontal high fiequency and low 
Irequency components and recorded m each ot multiple 
angles. As shown in Figure 19. a signal is divided into a 
basic signal (sum signal) and a sub signal (ditieientiai 
signal) by a sum calculation section I4i and a ditieien- 
tiai calculation section 143. The lesuliant signals aie 
MPEG-encoded and then aliernately lecoided as irrtei- 
leave blocks In units of 1 GOP. At this point, the amount 
of the information can be i educed by 20% by perfoi ming 
a 3-2 conversion of the basic signal and the sub signal 
in synchronization with each olhei It is eflicieni to use. 
as the basic signal. "IBBPBBPBBPBBPBB* which is 
shown as a main GOP structuie 244 used lor the ordi- 
nary KAPEG encoding. In this siructure, an I iiame 246, 
B frames 248 and P frames 247 are alternately 
arranged. In the case of the differential signal, however, 
experiments have shown that it is efficient to have a 
structure including only I frames 246 and P frames 247 
due to the profile pattern, for example. "IPPPPPP- 
pippppppp" shown as a sub GOP structure 245. The 
efficiency is improved by changing the setting for the 
sub GOP structure. 

40076] Figure 19 shows an exarrple in which a 
480P video signal is divided into two in a vertical dii ac- 
tion. Figure 21 (described below) shows an example in 
which a 480P video signal is divided into two in a hori- 
zontal direction. In an alternative manner, a 60-frame 
480P signal may be divided by frame division means 
into 30 odd frames and 30 even frames. In this case, the 
respective 30P signals are converted into two 60-field 
interlace signals, and each ot the signals are MPEG- 
encoded and recorded in the MADM system. Such 
encoding Is performed in a progressive manner, and 
therefore ericoding efficiency is improved as in the case 
of the movie. Thus, the recordable time period of the 
same disk is extended. 

{0077] When such a signal is reproduced by a non- 
MADM reproduction apparatus, a SOP (one-channel) 
525 interlace signal is reproduced in a first channel. 
Such a signal lacks necessary frames and is distorted. 
[0078] When such a signal is reproduced by an 
MADM repioduction apparatus, a 30P signal is repro* 
duced as a basic signal and another 30P signal is repro- 
duced as a sub signal. These two 30-frame signals are 
sy 'resized into a 60-frame normal 480P signal by 
frame synthesis means including a frame buffer, and 
then output. 

(0079] When a line doubler is added to an output 
section for the 480P signal, a lOSOP video signal is 
obtained. 

[0080] When a 525 interlace signal is input to a sum 
signal section of the synthesis section of the MADM 



lepioduction apparatus arid the value o1 0 is input to a 
diffeiential signal section of the synthesis section, a 
480P video signal is obtained Such a mannet of input 
has the same effecl as the line doublei This method 
altovi's even a 525 inteilace signal to be output as a 
480P Signal Accordingly, all types ot ptctuies can be 
viewed by simply conneamg one cable to a pogi essive 
input teiminat ot the MADM leproduction apparatus. 
(0081] In Figure 19. 1/2(A+B) and T/2(A-B) are 
u'. used as expiessions foi calculation foi a two-tap. filtei. 
The division fiequency coiiesponds to about 300 scan- 
ning lines. 

[0082] As shown in Figui e 19. the disk 724a having 
a 480P signal in the state of being divided into two sig- 

75 nals by sum and diflei ential calculations and lecoided in 
two block groups, i.e.. the fiist interleave blocks and the 
second interleave blocks is lepioduced. The signal is 
divided into a 480i signal as a basic signal and a 480i 
signal as a differential signal by the division section 734. 

PC The signals are respectively decoded by the MPEG 
decoders 728 and the MPEG decoder 730 to obtain a 
480i signal 729a and a 480i differential signal 731a. The 
addition section 740 performs the calculation of <a+b)/2 
to synthesize the two 480i signals Thus, a 480P (60 

pf frames) synthesis signal 733a is output 

[0083] The disk 724 includes 480iM80P/720P iden- 
tification information 744 (Figure 17) recorded in a toe 
section or the like thereof. The 480i/480P/720P identifi- 
cation information 744 includes three signals in the case 

5c Of the 480i signal, the 480P signal and the 720P signal, 
and also shows which resolution of differential signals 
are recorded. The identification information processing 
section 743 processes this information to determine in 
which sector address of the disk main data (main signal) 

55 and sub data (differential signal) of the hierarchical data 
are recorded. The identification information processing 
section 743 then sends information on the start point 
and the like to the synthesis section 732. The synthesis 
section 732 performs a synthesis calculation of the main 

<c data and the sub data from the start point of the 480P 
signal and outputs a 480P (60 Irames/sec.) signal. 
10084] As shown in Figure 17, row of Vts=6. it is 
recoided on the disk that at the start point of the 720P 
signal, 720P*main Is the first interleave block, and 

45 720P-sub is the secorvj interleave block. The identifica- 
tion information processing section 743 identifies this 
information. The calculation section 740 performs a 
synthesis calculation of the 720P signal, for exarrple, 
(a+b)/2 from the start time stamp of the 720P signal. 

6c using the time stamps of the main signal and the differ- 
ential signal from the MPEG decoders 728 and 730. and 
then outputs a 720P signal. 

[0085] When a 480P identifier is recorded as the 
identification information 744 <f igure 17). the identifica- 
£5 tion information processing section 745 sends a 480i 
signal oecoding instruction to the MPEG decoder 730 
and causes the MPEG decoder 730 to decode the 480i 
signal- Then, a diffeiential signal 731 a of the 480i signal 
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is decoded and synthesized by ihe synihei,is section 
732. Thus, a 480P (60 iiames/sec.) is output 
10086] In this manner, the MPEG decodei 730 pei- 
lorms the 480i processing (480P 30 tiames/sec ) oi the 
720P piocessmg in accordance with the identiiication 
information. Thus, the mam signal and the difleiential 
signal of the 480i signal, and the mam signal and the 
sub signal o1 the 720P signal, can be decoded by two 
MPEG decoders in total. This has the etiect ol simplity- 
ing the stiuctuie ol the apparatus. 

[0087] The 4 SOP lepioduclion mode shown in Fig- 
ure 10 does not use the 480P/720P up-convenei 738 in 
the synthesis seaion 732. but allows the decoded 480P 
(60) signal to be up-conveited to a 720P signal by the 
4S0P to 720P up-conveitei 738 and thus displayed on a 
HD video pojectoi loi 720P oi the like. Thus, the scan- 
ning lines are advantageously more unlikely to be 
viewed- In this case, one 480P to 720P up- converter 
738 can be used for 720 P signal synthesis and 480P to 
720P up-conversion. Thus, the 480P signal can advan- 
tageously be up-converted into a 720P signal without 
adding any element. 

(720P/480P/480i three hierarchical layer recoiding 
apparatus) 

{0088] With reference to Figure 5. a structure and 
an operation of the 720P (60 frames/sec.)-type three 
hierarchicat layer recording apparatus will be described. 
The structure and the operation are substantially the 
same as those in Figure 1 , and only the diflerent parts 
will be described. First, an input signal is a 720P signal 
of 60 frames/sec. Accordingly, after being 480P down- 
converted, the input signal is a 480P signal of 60 
frames/sec. This signal is input to a basic signal 
processing section 721 a and processed by a division 
section 747. Where the pixel data of the n th line is a and 
the pixel data of the (n-»-i)th line is b. the division section 
747 uses the calculation result of (a4-b)/2 lor the m'th 
line of a 480i video signal 748a and the calculation 
result of (a-b)/2 for the m'th line of a 4801 video signal 
748b. and thus obtains a main signal and a sub signal 
of an NTSC signal. These signals aie respectively 
encoded by the MPEG encoders 708a and 708b. and 
decoded by the MPEG decoders 709a and 709b into 
decoded signals 749a atKl 749b. The signals are syn- 
thesized by a synthesis section 748 into a 480 P signal 
710. The 480P signal is up-converted into a 720P signal 
714. and drffeienlial information is obtained. The differ- 
ential information is MPEG-encoded to obtain data as 
third interleave block data 718a and 718b. This proce- 
dure is substantially the same as that in Figure 1 except 
that the frame rate is 60 frames/sec. instead of 24 
frames/sec. 

[0089] The 480i MPE<3 stream is divided by multi- 
plex means 719a into interleave blocks on an nGOP 
basis. The nGOPs are interleaved in the order from a 
480i signal (first interleave blocks 722a of a basic sig- 



nal), then a 480i signal (second intei leave WocKs. 750a 
of a dittei ential signal), and then a 720P (thud intei leave 
t3locks7l8a of a difleiential signal), and lecoided on the 
disk 724 such as a DVD. 

5 (0090] In this case, the multiplexed signals are 
modulated by an 8VSB. QAM oi OFDM modulation sec- 
tion 751 and transmitted from a iransn^nssion section 
752. Thus, hieiaichical bi oadcasting can be performed. 
The signals may be multiplexed by time division based 

10 on a time domain defined by the broadcasting instead of 
based on a GOF 

10091] In this mannei. a 480i/480P (60)/720P three 
hierarchical layei disk oi hierarchical bi oadcasting is 
realized. 

15 (0092] With lefeience to Figure 2. an operation for 
reproducing the disk 724a will be described. Since iden- 
tical elements with those in Figure 3 are included, the 
identical elements will not be described. A signal repio- 
duced from the disk 724a or received by a receiving ^ 

po section 753 and demodulated by a demodulation sec- 
tion 754 is divided by the division section 734 into three 
streams based on the above-mentioned interleave 
blocks. The three streams are decoded by the three 
MPEG decoders 728a. 728b and 730 through buffers 

?:> 735a. 735b and 736. Then, three signals, i.e.. the 480i 
signal 749a, the 480i differential signal 749b. and the 
720P differential signal 731 are obtained as a result of 
demodulation. By subjecting the 480i basic signal 749a 
and the 480i differential signal 749b to the calculations 

so of (a-fb) and (a-b) by a synthesis section 732. a 480P 
(60 frames/sec.) video signal 729 can be obtained This 
signal and the above-mentioned 720P differential signal 
731 are synthesized into a 720P output 733a- The pro- 
cedure is described above and will not be repeated. 

35 [0093] In this manner, three types of outputs of 480i 
output 749a. 480P output 729 and 720P output 733a 
having different resolutions can be obtained from the 
disk 724a. The user can select the output by the grade 
of the monitor reproduction apparatus. That is, the 480i 

40 <NTSC) grade output is obtained by the existing repro- 
duction apparatus, the 480P (60 frames/sec.) is 
obtained by the reproduction apparatus for 480P 
according to the present invention, and the 720P (60 
fiames/sec.) is obtained by the reproduction apparatus 
for 720P according to the present invention. Thus, the 
complete compatibility is lealized. 
10094] In Figure 2, when the identification informa- 
tion processing section 745 detects a high resolution 
identifier, the rotation rate of the motor is raised through 

50 a system control section 21 and a rotation control circuit 
35. A high resolution signal can be reproduced by rais- 
ing the rotation rate in accordance with the identifier. 
The rotation rate is raised to 1X for reproduction of a 
standard picture. 2X lor 480P and 720P (24P). and 3X 

£5 to 4X for 720P (60F). The effect of power saving is pro- 
vided. Then an NTSC grade signal is reproduced, the 
system control section 21 stops or operates, at a low 
rate, clocks of the 720P MPEG decoder 730. the 480i 
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MPEG decode! 728b. and the synlhesij. section 732 
which are not necessary Thus, pov/ei conbunipiion can 
be sjqnilicantly leduced ThenanAlPi: 84 oi the audio 
time stamp ot audio data is leceived by an AV' synchio- 
nization control section 158 and a video piesentation 
time stamp VPTS toi each o1 the MPhG decodeis is 
cieaied based on the time mtoimation ana set m legis- 
teis 39a. 39b and 39c ot the decodeit. tiames can be 
synchionized toi lepioduction liom me decodeis In 
oidei to synchionize the veitica! blanking, a decoder 
synchionizalion section 794 simultaneously lesets the 
hori2onlal and v/edical synchionizalion o1 the decoders 
The pictures liom the decoders can be synchronized on 
a dot-by -dot basts SpecHic synchiomralion methods of 
audio and video signals will be desciil^ed latei. 
10095] Piom the disk 724a. a fiist lesolulion idenli- 
iiei indicaling a low resolution o1 NTSC signals or the 
like ot the picture o1 the first stieam and a second reso- 
lution identifiei indicating a high resolution o1 720P sig- 
nals or the like ot the second and thud streams are 
reproduced The system control section 21 determines 
by calculation which processing is to be performed by 
the up-converter 738 in the synthesis section 732 
among 480P to 720P. 480P to 10801. 480P to 1080P 
and 720P to 1080P. and indicates the result to the syn- 
thesis section 732 In actuality, various first resolution 
identifiers exist such as. tor example. 704 - 480 and 720 
X 480. This has an effect that the up-converter operates 
at the optimum ratio Needless to say, a simple system 
structure in which an identifier indicating the ratio of the 
up-converter is recorded and reproduced can be 
adopted. 

{€096] The reproduction apparatus 743a in Figure 2 
can output three resolutions of signals (i.e., 480i 
(NTSC) signal of the first stieam. 480F (60P) signal 729 
of the first and second streams, and 720P (SOP) signal 
733a of the first, second and third streams) simultane- 
ously or at different timing. Such a reproduction appara- 
tus can be used with monitors having various 
resolutions. 

10097] Especially, since a 460F signal 729 can be 
converted into a 720P signal by the up-converter 738 of 
the synthesis section 732. the 720F signal obtained as 
a result of conversion of the 480F signal can be 
obtained without adding any circuit. 
(0098] In the case where a receiving section 753 
and a demodulation section 754 are added to the hier- 
archical reproduction apparatus, a receiving apparatus 
for receiving a hierarchical signal such as a TV signal, 
demodulating the signal and outputting three resolu- 
tions of video signals can be provided. 

(Wide 480P) 

[0099] With reference to Figure 21 , a concept of the 
MADM system in which a signal is divided in a horizon- 
tal direction is shown. The signal can be converted by a 
3-2 conversion section 174 into a 1440 > 480i interlace 



signal The signal is divided into two in a horizontal 
dweciion by a horrzontal filtering section 206a. The prin- 
ciple ot filienng is shown rn parts <a) and <b) c1 Figure 
34 As shown in pari (b). 1440 dots are divided into odd 

5 dots 263a and 263b. and even dots 264a and 264b 
Where the odd dots are labeled as Xn and the Bven dots 
are labeleo as Yn. a sum signal is obtained by the cal- 
culation ot X^ Y and a ditlerential signal is obtained 43y 
the calculation of X-Y. As a result, two 480P or 525i sig- 

u nals. each ot 720-460. are obtained as shown in part 
(b) ol Figure 34 

|0100) Returning to Frgure 21 , the mjmber of hon- 
zontal dots ot such a hor izontal sum-signal is reduced to 
720 Since the signal is passed through the horizontal 

15 filter, however, aliasing distortion is as low as that of an 
NTSC signal. A conventional reproduction apparatus 
reproduces only the sum signal and accordingly pro- 
vides a DVD picture of exactly the same quality. The dif- 
ferential signal represents only a profile formed of line- 

po drawing. However, since the difference signal is 
restncled by a second video signal output rastriction 
information provision section 179X^igure 60) «o as not 
to be reproduced by an ordinary reproduction appara- 
tus, no problem occurs The sum ^signal and the differ- 

25 ential signal are respectively encoded into MP€G 
streams by a first encoder 3a and a -second encoder 3b. 
and subjected to interleaving in units of an interleave 
block of 1 GOP or more and MADM-multiplexed. 
[0101] In the case of the movie. 3-2 .conversion is 

30 performed by the 3-2 conversion 174 section arxJ 
MADM-recoided as an MP€G signal together with the 
3-2 conversion information 174. 

[0102] In the case of the movie. 24 frames are 
reproduced in one second. Accordingly, a 1440 x 480P 

55 progressive picture is reproduced based on two inter- 
lace signals by a 2X reproduction apparatus. The scope 
size of the movie is 2.35:1 The format of 1440x480P is 
suitable for the scope size of 2.35:1 in terms of the 
aspect ratio Thus, a wide scr^n 480P is €ttectively 

46 reproduced. 

[0103] A wide 460i hierarchical disk 72Ab is 
described with reference to "Figure 21 above. With refer- 
ence to Figure 4, an operation for reproducing the disk 
724b by a W-460i reproduction apparatus will be 

<5 described When the disk 724b has information 
recorded at 24 frames/sec. a W-480P basic signal 757a 
and a W480P differential signal 7S7b are obtained toy 
decoding perlormed by field frame conversion sections 
756a and 756b. Each pixel is encoded toy data obtained 

sc by (X4Y)/2 or (X-Y)/2. Accordingly, when a synthesis 
section 758 performs the calculation of 
(X4Y)/2+(X-Y)/2 . X. i.e.. data of odd pixels is obtained 
by the decoding. Wnen the synthesis section 758 per- 
forms the calculation of (X+Y)/2-(X-Y)/2 . Y. i.e.. data of 

££ even pixels is obtained by the decoding. As a fesult. the 
number of pixels in the horizontal direction is doubled to 
1440 pixels. In this manner, a W480P video signal 759 
ol 1440 > 480P pixels is obtained. The W480P video 
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signal 759 o1 1440 • 4 SOP pi>et:> is conveited by a 
W480P-720P conversion section 760 so as !o have 
1280 pixels in the houronlal diieclton using a 8/9 hoii- 
?on1al titlei 760a. and so as to have 720 pixels in the 
vertical direction using a 3/2 vertical iiltei 760b. As a * 
le&ult. a 720P digital output is obtained I hus. use ol a 
geneial 720P digital inteiiace is advantageously 
allowed. 

(Detailed lepioduciion opeiation. Figuie 25) ;r 

|0104] Wrth reteience to Higuie 25. an opeiation ol 
a lepioduaion appaiatus 65 accoiding to the present 
invention will be desciibed in detail. Figuie 25 is a block 
diagram ol a lepioduction appaiatus loi lepioducing a it 
2X pjogiessive oi supei-wide pictuie oi 720P signal. A 
signal reproduced tiom an optical disk 1 is divided by a 
division section 68 into liist interleave blocks 66 and 
second interleave blocks 67 each including a frame sig- 
nal ol iGOP or rrxjre. Frame video signals 70a and 70b 
each oi 30 frames/sec. obtained as a lesuH of MPEG 
extension performed by an extension section 69 are 
respectively divided by field division sections 71a and 
71b into odd field signals 72a and 72b and even lield 
signals 73a and 73b Thus, 2ch T\1TSC interlace signals Pt: 
74a and 74b are output. The wide screen shown in Fig- 
ure 20 will be desciibed later. Referring to Figure 25. 
using the method described above, a 1440 v 960 pro- 
gressive pictuie 182a is divided in a horizontal direction 
using a sub band filter or wavelet conversion by a hori- 3o 
2ontaI and vertical division section 194 in a picture divi- 
sion section 115. Thus, a 525 progressive video signal 
183 is obtained. This signal is divided into 525 interlace 
signals 184 and recorded as streams 188a and the like. 
[0105] Remaining interpolation information 185 is 
divided similarly intofoui sti earns I88c. I88d. 188eand 
I88f and recorded as interleave blocks. The maximum 
transfer rate of each interleave block is 8 Mbps by the 
DVD standards. Accoidingly, when the interpolation 
irriormation is divided into tour streams, the transfer rate 
is 32 Mbps. When the interpolation Infotmation is 
divided into six angles, the transfei rate is 48 Mbps. 
Thus, a 720F oi 1050P HDTV video signal can be 
recorded. By the conventional r eproduction apparatus, 
the stream 188a is reproduced to output an interlace <£ 
video signal 184. Regarding the streams 188c. I88d. 
I88e and I88f, output restriction information is 
recorded on an optical disk 187 by a picture processing 
restriction information generation section 179. There- 
fore, the interpolation information 185. such as differen- sc^ 
tial information or the like, which is not properly viewable 
is prevented from inadvertently being output. By divid- 
ing the signal in horizontal and vertical directions by the 
system shown in Figure 25. an optical disk compatible 
to both the HDTV and NTSC for mats is advantageously ee 
realized. 

{0106] In Figure 25. the interlace signal obtained by 
the conversion performed by an interlace conversion 



section 175 is output to provide a scope screen 178 A 
480P piogiessive signal is similarly output on a scope 
scieen 178. When a monitor for 720P is used, a 480P 
signal is converted into a 720P progressive signal by a 
480P/720P conversion section 176. and as a result, 
output on a 1280 > 720 or 1440 > 720 letter box type 
720P scieen 177 (the picture has 1280 x 480 oi 1440 > 
480 pixels). Since the scope picture (2.35:1) has n28 > 
480 pixels, a pictuie having a size closer to the aspea 
latio is obtained. Especially in the case of a movie, the 
Signal is ol 24 liames/sec. and so the progiessive pic- 
tuie is transferred at the rate of 4 Mbp>s. When a scope 
picture is lecorded by the system according to the 
piesent invention of dividing the picture into two 
scieens. the transfer rale is 8 Mbps. In such a case, 
about 2 hours of information can be recorded on a two- 
layer DVD. Accoidingly. a 720P or 480P high quality pro- 
gi essive picture signal for scope screen can be advan- 
tageously recorded on one DVD. On a conventional TV 
screen, the picture is displayed by an interlace output 
signal, needless to say The present invention has an 
effect that a scope screen picture (2.35:1) of the movie 
can be output as a 480P or 720P signal. 

(High resolution recording identification information) 

101 07] Returning to Figure 1 . address information is 
output from an address circuit. A hierarchical recording 
identifier 725 including progressive/3 D picture arrange- 
ment information is output from a progr€Ssive/3D pic- 
ture airangement information output section 725a. 
These pieces of information are recorded on the optical 
disk by a recording circuit 723. The progressive/3D pic- 
ture arrangement information includes an identifier 
which indicates whether or not a progressive or 3D pic- 
ture is present on the optical disk, the hierarchical 
recording identifier 725 v^ich indicates whether or not 
the signal is up-converted when being hierarchy- 
encoded, or a progressive/3 D picture arrangement table 
14 Shown in Figure 17. As shown in Figure 17. a TEX- 
TDT file 83 includes, for each VTS. 3D pictures for the 
light and left eyes and angle numbers and cell numbers 
in which the progressive signal is located. Since a PGC 
file of each VTS includes a start addr.ess and a termina- 
tion address of each cell, the start address and the ter- 
mination address of each cell are included in the 
progressive/3D picture arrangement information. Based 
on the arrangement information and identification infor- 
mation, the reproduction apparatus outputs a progres- 
sive picture or a 3D picture correctly as progressive 
outputs or R and L outputs. When ordinary pictures of 
different contents from each other are output as R and L 
outputs in error, the user will feel uncomfortable since 
the pictures for the right eye and the left eye are not 
related to each other. The progressive/3D picture 
arrangement information, the progressive/3D picture 
identrfier, or the hierarchical recording identifier has an 
effect of avoiding the output of such unpleasant pic- 
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tuies. As shown in Figuie 3. when the hieiaichica 
recording idenldiei 725 ts lepioduced. Ihe ccnirol ^ec 
tion sends an up-conveision msliuciion 766 lo up- con 
ven the a 480P signal into a 720F signal by the up- 
converter 738. Then, the synthesis of the 7?0P signal is 
penormed. When the hieraichicai lecoidmg identitiei 
725 IS not available, a 480P signal is output attei pei- 
torming synthesis calculation without using the up-con- 
vertei 738 as shown m Figuie 10 In this mannei. stable 
picture synthesis can be perlormed simply by switching 
the connection in accoidance with whethei oi not the 
identifier is available. 

[0108] With reteience to Figuie 23. a piocess toi 
pertorming lepioduction using a pictuie identitiei 222 
will be described. 

{0109] From the optical disk, lepioduction piocess 
control information 225 is first read liom the manage 
ment information 224. Since the inloimation 225 
includes restriction information on VOE, a 0th VOB 
226a is only connected to a first VOB 226b having a 
main picture by an existing repi eduction apparatus 
Since the 0th VOB 226a is not connected to a second 
VOB 226c having an interpolation signal such as differ- 
ential information or the like, an ugly picture such as dif- 
ferential information is prevented from being output by 
the existing reproduction apparatus as described 
above. Each VOB of the main signal has a picture iden- 
tifier. Since the progressive identifier=i and resolution 
identlfier=00 (525) in the first VOB 226b and the second 
VOB 226c. a progressive signal having 525 scanning 
lines is reproduced from a progressive or HD reproduc- 
tion apparatus. 

10110] In a picture identifier 222 of the next VOB 
226d, the progressive identifier =0 and the resolution 
identifier 219=10. This indicates that an interlace signal 
having 1050 scanning lines is output and that three 
VOBs 226e, 226f and 226g are interpolation informa- 
tion. Thus, an NTSC signal is output by a conventional 
reproduction apparatus, an interlace signal having 720 
horizontal pixels and 1050 vertical pixels is output by a 
progressive reproduction apparatus, and a full HDTV- 
format signal having 1050 scanning lines is output by a 
HD reproduction apparatus. As can be appreciated from 
this, various video signals can be recorded in an inter- 
leave manner and reproduced by the picture identifier 
222. The picture identifier 222 can be recorded in the 
management information 224. 

<2X clock and softndecoding) 

[0111] In the block diagrams shown in Figures 3 
and 4. two MPEG decoders are used. In Figure 18, a 
first MPEG signal and a second MPEG signal ate syn- 
thesized into one MPEG signal by a synthesis section 
36. and a 2X clock is generated by a 2X clock genera- 
tion section 37. The MPEG signal is doubled by a 2X 
clock-type MPEG decoder 1 6c. extended, and output as 
R and L video signals by a division section 38. In this 



mannei. the ciicuit conliyuiation can be simptitied 1 his 
circuit configuration is. lealized simply by adding a 16 
MB SD-RAM to a memoiy 39 oi the existing lepi educ- 
tion apparatus, without significantly laismg the cost Foi 
; soft-decoding, when a CPU has a 2X clock, one CPU 
realizes simultaneous decoding by time division Itiis 
wilt be described m a second example. 

(Simultaneous repioduction) 

74' 

[0112] With reference to Figuie 18. synchionous 
lepioduction of two sti earns, which is impoiiant in 
decoding 3D pictuie data and piogressive pictuie data 
will be described Fust, it is necessaiy to adjust veitical 
n and horizontal synchionization ol two streams within a 
single line. Inoidei to do this, a lirst MPEGdecodei l6a 
and a second MPEG decodei 16b are started substan- 
tially simultaneously by a vertical/horizontal synchroni- 
zation control section 85c to synchionize the decoders 
PC. I6a and 16b. Then, it is necessary that the outputs fiom 
the two decoders should be a picture having an identical 
VPTS. This will be described with reference to the flow- 
chart in Figure 26 and Figure 18. In step 241a. the syn- 
chronization oi a first decodei and a second decoder is 
^5 cancelled. In step 241 b. the decoders are synchronized 
with each other vertically arvd horizontally as described 
above. In step 241c. an APTS of an audio signal is read, 
and the APTS value is set as an initial value of an STC 
of the first decodei and an STC of the second decodei . 
30 In step 2416. processing of the first decoder is started. 
In step 241 f. it is checked whether or not a first VPT£ 
has reached the initial value. If yes. decoding is started 
in step 241 g. In step 241 h, a processing delay time 
period of the first decoder is calculated, and the VPTS 
35 of the decoder output is adjusted so that the APTS and 
the VPTS are synchronized with each other. Since the 
second decoder is processed in the same manner, the 
picture from the first decoder and the picture from the 
second decoder aie synchronized with each other. 
<c Thus, the decodei outputs, i.e.. the first MPEG signal 
and the second MPEG signal are synchronized within 
one line. Then, the synchronization on a dot-t>y-dot 
basis is obtained by a video signal synchronization sec- 
tion 36a of the synthesis section 36. Anoriginal progres- 
<5 sive picture is obtained even by a sum calculation. As 
shown in Figure 5. in the case where an APTS 84 is 
read by the audio decoder 1 6c and an identical APTS is 
set in registers 39a and 39b of the STCs of the tv^o 
MPEG decoders 1 6a and 1 6b. an audio stream and the 
BO two video stream are automatically synchronized with 
one another. 

|011 3] In the piesent invention, when the buffer cir- 
cuits 23a and 23b underflow, either one of the pictures 
is disconnected, as a result of which a disturl^ed pro- 
5f gressive picture is output. In order to avoid this, the 
butler amounts 0I the two buffer ciicurts are conti oiled 
by a buffer amount control section 23c as shown in Fig- 
uie 2. This operation is illustrated in the flowchart shown 
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in Figure 27. Fiist. in step 240a. a ina>imtjm iniei leave 
value among the NAVI inloi mation of each disK is lead. 
and a ma^fimum value o1 1 ILB m one mam mi ei leave 
block is sel The nnaximum value is usually Si 2 seciois. 
i.e.. atx>u1 1 MB. When the maximum value is sel below * 

I MB by a specHic lot mat. that value is set as the niaxi- 
mum value. Next, when an instiuction to simultaneously 
reproduce the main and sub interleave blocks is issued 
in step 240b. i1 the butle* amount oi the lust butlei ciicuit 
23a is 1 ILB or less in step 240c. an insii uclion to lepio- 
duce the data fiom the mam interleave blocK and tians- 
<ei the data to the first buffer circuit 23a is issued. Then, 
the processing goes back to steps 240b and 240c. The 
transfer is stopped in step 24 Od when the buffer amount 
of the first buffer circuit exceeds 1 1LB. Since the data in 
the buffer circuit 23a becomes 1 1LB or more in this man- 
ner, underflow is prevented. 

[0114] In step 240f. a maximum value of a sub intei- . 
leave block of 1 ILB- Sub is set in the buffer circuit 23b. 
Simultaneous reproduction is performed in step 240g. 
When the data in the second buffer drcuii 23b is 1/2 
ILB-Sub or less in step 240h. data is read into the buffer 
circuit in step 240j. When the data is more than 1/2 ILB- 
Sub. the reading is stopped in step 240i 
[0115] As shown in pari (4) of Figure 24. the data 
amount of 1/2 ILB is sufficient in the second butter cir- 
cuit. Accordingly, the buffer amount can be reduced to 
half. The buffer control in Figure 27 eliminates the 
underflow of the buffer circuits, thus reducing distur- 
bance in the synthesized picture during reproduction. 

(Required capacity of the track buffer: Fioures 23 and 

[0116] First, a method for synchronizing two video 
streams according to the presem invention will be 
described. First, as shown in Figure 39. a system repro- 
duced from the optical disk is once accumulated in a 
track butter 23 and then sent to a first video decoder 
69d and a second video decoder 69c. In the track ot the 
optical disk, a first stream A and a second stream B of 
the progressive signal are alternately recorded on an. 
interleave block-by-interleave block basis. 
10117] First, the stream A is reproduced at 2X rota- 
tion. and data accumulation in a first track buffer 23a in 
the track buffer 23 is started. As shown in part (1) of Fig- 
ure 24. when t^t! to t2. data for i interleave block (ILB) 

II of the first video signal for 1 interleave time Ti is 
accumulated. A first track butter date amount is 
increased, and becomes equal to i ILB at t=t2. Thus, 
data accumulation for 1 ILB of the first video signal is 
completed- At t=t2. after accumulation of data for 1 ILB 
of the first video signal corresponding to 1 GOP or more 
is completed, the second video signal (stream B) is 
reproduced from the optical disk starting from the inter- 
leave block 12. As shown in the solid line in part (4) of 
Figure 24. data accumulation ot the second video signal 
in a second track buffer 23b is started at t=t2 and con- 



tinued until t=t6 Fiom I=t2 through i6. as shov^'n m parts 
(7) and (10) of Figuie 24. the video presentation time 
stamps (VPTS) of the first video signal and the second 
video signal are synchionized and lespectively sent to 
the first video decodei 69c and the second video 
decoder 69d from the track butter 23a and the track 
buffer 23b. As shown in parts(8) and (ii) ot Figure 24. 
the input signals are output as two pieces ot video data 
after being extended by the first and second video 
decoders 69c and 69d. The output of these pieces of 
data starts at t:^t3. which is delayed by a video delay 
time period twd. which is required for MPEG extension 
of the data. From t=t4 through tlO. the streams A and B 
are synthesized into a progressive signal by a progres- 
sive conversion section 170. Thus, a progressive signal 
for one interleave block is output. 

[0118] As described above, from 1=:t2 through t8. 
data for one interleave block is input to the decoders. 
Accordingly, the data in the first track buffer 23a and the 
data in the second ti ack buffer 23b ai e consumed and 
reduced at substantially the same rate. Therefore, as 
shown in part (2) ot Figure 24. the data amount in the 
first track buffer is reduced from t=t2 through 17. At t=t7, 
the data amount is i/2of i ILB. Since data reproduction 
for the interleave block 15 starts at t=t7. the data amount 
increases until t=t8. when the data amount reaches 1 
ILB. Since data input to the first decodei 69c starts at 
t=t8 as at t=:t2. the data amount reduces until t=tl1. 
Finally, the buffer memory amount becomes 1/2 ILB. 
(0119) With reference to part (4) of Figure 24. a 
change in the memory amount in the second track 
twffer 23a for stream B will be described. At t=t2. input 
of data 81 for the interleave block 12 of stream B in the 
second track buffer 23b starts. At the same time, trans- 
fer of data Bi to the second video decoder 69d starts. 
Accordingly, the buffer amount at t=t6 is 1/2 ILB. When 
2-angle recording of a progressive signal according to 
the present invention is performed, it is necessary to 
perform a track jump to the interleave block 15 over the 
interleave blocks 13 and 14 from time t=6 to t=7 since 
there are four streams, i.e.. four interleave blocks. Dur- 
ing the jump period 197 (tj). data input from the optical 
disk is interrupted. Thus, the buffer amount of the 
stream B is reduced until t=t8, when the buffer amount 
is close to zero. 

10120] Since input of data B2 ot the interleave block 
16 starts at t=t&. the buffer amount starts increasing 
again. At t=ti 1 . the memory amount of the second track 
butter is 1/2 ILE. At t=t1 1 . a track jump to the interleave 
block I& ot A3 over the interleave blocks 17 and 18 is per- 
formed. 

[0121] The above -described operation is repeated 
(0122] Now, the minimum necessary memory 
capacity tor a track butter 23 (total capacity o1 the first 
and second track buffers 23a and 23b} according to the 
system of the present invention will be described. A 
track buffer capacity 198 indicated by the dotted line in 
part (4) ot Figure 24 shows the total data amount in the 
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ill si and second tiack butleis 23a and 23b A conlmu- 
ous lepiodudion is ieali?ed by setimp ihe lotsl capacity 
oi a minimum i ILB m the tiacK butlei 
fOl23] Accoiding to the present invention, the total 
capacity ot the liacK bufleis 23a and 23b is> set to be ^ t 
iniei leave block oi moie foi lepioduciion ot a piogies- 
sive signal Thus, overllow and uncerllow ot the track 
butler ar e pi evented 

(Method lot contiol the system clock) u 

I0124J A method toi switching ihe system clock 
SIC between two stieams will be desciibed with reler- 
ence to Figuie 28. A piogressive signal includes two 
stieams A and B. Heie. the sli earns ot two mteilace sig- 15 
nals toiming a i ILB piogiessive signal aie relet led to 
as AT and El. As shown inpait (1) oi figure 28. data Al 
toi stream A is leproduced duiing the 1/2 ILB time 
period and a!f the data is recorded in the buffer. Then, 
as shown in part (2) of Figure 28. data foi stream B is 
leproduced as Bl and stored in the buffer after Ai is 
leproduced. Since the data reproduced from the optical 
disk is restricted with stream B (part (2) of Figure 28) as 
desciibed above, the track buffe? does not overflow 
Stream A (part (3) of Figure 28) 01 stream clock (SCR) P5. 
from the track buffer for stream B is reset substantially in 
synchronization with the start point J of the reproduction 
of stream E (part (2) of Figure 28). Since stream B is 
output at the rate of 2X. the stream clock is counted at 
the rate of iX as shown in part (3) of Figure 28. i.e.. at sc 
half the rate of stream B due to the buffer. At point G. the 
stream clock is reset. Time VPTS2 at which the video 
signal for stream B is output from the video decoder 
needs to be synchronized in consideration of the delay 
time period Tvd due to, for example. MPEG decoding 55 
time period. In this case, at point I (t=Ti). when the 
VPTS stops rising, AV synchronization control is 
restarted. By checking VPTS2 of stream B and synchro- 
nizing VPTSl of stream A to VPTS2. synchronization is 
realized by one-system simple control. VPTSl can be <fo 
used additionally. 

10125] Audio data of synchronizing stream B is 
reproduced and the system clock is switched at point H 
using APTS of stream B as shown in pari (4) of Figure 
28. Regarding a sub picture signal of stream E. the STC <t 
can be switched in a similar manner. 
[0126] By using data of stream B with priority. AV 
synchronization is realized with simple control. 
(0127] Since ail the data in streams Al and A2 is 
stored in the buffer memory, the buffer memory does not sc 
c ^ ilow. Stream Bi may possibly overflow. However, 
according to the present invention, the synchronization 
control is performed using stream E and thus the sys- 
tem clock is switched tc control the signal flow so that 
VPTS2 does not exceed the VP7S2 threshold level as £f 
shown in part (6) of Figure 28. Therefore, the buffer 
does not overflow. 

fOl28] According to the present invention, the audio 



signal of stream E is used for audio reproduction. 
IhHHoje. the buffei anx>unt of audio decoder is 
leduc ec to 1/2 Furthermore, by switching the system 
clock at point H{i=Th) as shown in part (4) of Figure 28. 
Ihe- audio signal is reproduced smoothly without 
e>ceeding the APIS threshold level. The sub picture 
mtoimaiion rs also reproduced with smooth synchronic 
zation Accoidingiy. pictuie. audio and sub picture [sub- 
titles 01 the like) signals are synchronized, and picture 
aixi audio are reproduced seamlessly with no inleirup- 
tion The audio signal and the sub picture signals of 
stteam A can be omitted. 

(AV synchronization- Figuf es 29. 30. 31 and 33) 

f0l29] AV synchronization, which is especially 
important I01 connection and the like when a jump is 
perfor med to repioduce two or three streams simultane- 
ously, will be described. This is important in the present 
invention, according to which the streams of the 720P 
signal and the 480i signal, which are significantly differ- 
ent fiom each other in the data amount, are synchro- 
nized. 

101 30] Figure 29 is a flowchart showing the detailed 
piocGss of reproduction of a program chain group per- 
formed by the system control section 21 . As shown in 
Figure 29. in steps 23Sa. 235b and 23Sc. the system 
control section 21 reads ^XDrresporxJing program chain 
information from the volume information file or a pro- 
gram chain information table of the video file. When the 
program chain is not completed in step 23Sd. the 
processing advances to step 23Se. 
101 31 ] In step 235e. it is determined whether or not 
the cur r ent cell and the immediately previous cell should 
be connected seamlessly referring to seamless connec- 
tion instr uction information for the cell to -be transferred 
next in the program chain information. If seamless con- 
nection IS necessary, the processing goes to step 2351 
toi seamless connection processing. If not. ordinary 
connection is performed. 

101 32] In step 2351. the mechanism control section 
and the signal processing section, for example, are con- 
ti oiled to read DSI packets, so that VOB reproduction 
end lime (VOB_^€_PTM) in the OSI packet of the cell 
which has been transferred and VOB reproduction start 
time (VOE^S.PTM) in the OSI packet of the cell to be 
transferred next are read. 

10133] In step 235h. "VOS reproduction end time 
(VOB_E_PTh/i) . V08 reproduction start time 
(VOE_S_PTM)" is found by calculation. The resultant 
value is sent to an STC offset synthesis section 164 in 
the AV synchronization control section 1S8 in Figure 30 
as an STC offset value between the current cell and the 
immediately pr evious cell which has been transferred. 
fOl 34] SimultaTOously. in ^ep 235i. V08 reproduc- 
tion end time (VOB_E_PTM) is transferred to an STC 
switch timing control section 166 as switching time T4 
for an STC switch 162e. 
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|0l3S] The sy&iem coniioi seciion 7^ ihen insliucts 
the mechanism conliol section lo continue leading data 
up lo the teimmal position o1 the cunent cell Thus, the 
data loj the cunent cell is tianslened to the tiacK butlet 
23 in step 235j. Upon completion ot the transiei. the 
piogiam chain mtoimation is lead m step 236c. 
10136] I! It is detei mined the seamless connection 
is not necessary jn step 235e. the data is iransleii ed to 
the tiack butler 23 up to the end o1 the system stieam. 
and then piogiam chain inloimation is lead in step 
235c 

10137) Heieinatiei. two examples ot a method toi 
AV synch! onization control toi seamless connection to 
perfoim seamless tepioduction will be desciibed. In 
othei woids. the AV synchionbation contiol section 158 
shown in Figuies 2 and 31 will be desciibed in detail. 
[0138] Relening to Figure 31. a system decoder 
161. an audio decoder 160. video decoders 69c and 
69d. and a sub picture decodei 159 are all synchro- 
nized to a system time clock given by the AV synchroni- 
zation contiol section in Figure 30 toptocess the data in 
the system stream. 

[0139] Regarding a tirst method, the AV synchioni- 
ralion control section 158 will be described with refei- 
ence to Figure 30. 

[0140] In Figure 30. the AV synchronization control 
section includes STC switches 162a. 162b. 162c and 
162d. an STC 163. an STC oflset synthesis section 
1 64, an STC setting section 165 and an STC switch tim- 
ing control section 166. 

[0141] The STC switches 162a. 162b. 162c, 162d 
and I62e switch between an output value o1 the STC 
163 and an output value o1 the STC offset synthesis 
section 164 as a reference clock to be provided to the 
system decoder 161. the audio decoder 160. the main 
video decoder 69c. the sub video decoder 69d and the 
sub picture decoder 159. respectively. 
[0142] The STC 163 is a reterence clock of the 
entire MPEG decoder shown in Figure 31 in ordinary 
reproduction. 

[0143] The STC offset synthesis section 164 contin- 
ues outputting a value obtained by subtracting the STC 
offset value provided by the system contiol section fiom 
the value of the STC 163. 

[0144] The STC setting section 165 sets en STC 
initial value given by the system control section or an 
STC offset synthesis value given by the STC offset syn- 
thesis section 164 in the STC 163 at the timing given by 
the STC switch timing control section 166. 
[0145] The STC switch timing control section 166 
controls the STC switches I62a through 162e and the 
STC setting section 165 based on STC switch timing 
information given by the system control section, the 
STC 163. and the STC offset synthesis value given by 
the STC offset synthesis section 164. 
[0146] The STC offset value is an offset value used 
for changing the STC value when system stream ^1 and 
system stream #2 having different STC initial values are 



continuously I epioduced. 

[01 47] The SI C offset value is specifically obtained 
by subtracting the "VOB reproduction start time 
(VOB_S_PTM)*^ described in the DSI of system stieam 
/ ??? to be lepioduced next from the "VOB reproduction 
end time (VOB_E_PTM)" described in the DSI packet of 
system stieam ^i reproduced first. The information 
regaiding I he display o1 such a value is pr e*calculated 
by reading data fiom the optical disk in Figure 5 by the 
system contiol section 167 when the data is input to the 
tiack buffer 23. 

|0i 48] The calculated offset value is supplied to the 
STC offset synthesis section 164 before the last pack ot 
system stieam ^1 is input to the system decodei 161 . 

7£ [0149] Except foi seamless connection contiol. the 
data decoding piocessing section 165 in Rgui e 5 oper- 
ates as an MPEG decoder. The STC offset value given 
by the system control section 21 is 0 or an arbitral y 
value. The STC switches 162a through 162e are always 

po selected to be connected to the STC 1B3. 

[0150] With lelerence to the flowchart in Figure 33. 
switching of the STC switches 162a through 162e in the 
connection part of the system control section and an 
operation of the STC 163 when two system streams 

?h having non-continuous STC values, such as system 
streams #i and #2, are continuously input to the system 
decoder 161 . will be described. 

[0151] The SCR. ARTS, VPTS and VDTS of the 
system streams ^1 and #2 to be input will not be 

30 descrit>ed. 

|01 52] It is assumed that in the STC 1 63. an initial 
STC value corresponding to system stream #1 which is 
being reproduced is set by the STC setting section 165, 
and the value is sequentially counted up in accordance 

35 with the reproduction. The system control section 21 
(Figure 31) calculates the STC offset value by the 
above-described method arKl sets this value in the STC 
offset synthesis section 164 before the last pack of sys- 
tem stream ^i is input to the decoder buffer. The STC 

^0 otiset synthesis section 164 continues outputting a 
value obtained by subtracting the STC offset value from 
the value of the STC 163 (step 168a). 
[0153] The STC switch timing control section 166 
obtains time Ti , at which the last pack of system stream 

<f *1 reproduced first is input to the decoder buffer, and 
switches the STC switch 162a to the output side of the 
STC offset synthesis section 164 at time Ti (step 
168b), 

[0154] Thereafter, the STC value referred to by the 
50 system decoder I6l is provided with an output from the 
STC offset synthesis section 164. The transfer timing of 
system stream *2 to the system decoder 161 is deter- 
mined by the SCR described in the pack header of sys- 
tem stream #2. 

55 [0155] Next, the STC switch timing control section . 
166 obtains time T2. at which the reproduction of the 
last audio frame of system stream #1 reproduced first is 
terminated, and switches the STC switch 162b to the 
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output side o1 the STC otiset synthesis section 164 ai 
time T2 (step 168c) A method loi obtaining lime 1 2* will 
be described later 

{0156] Theieaftei. the STC value leteiied to by the 
audio decoder 160 is piovided with an output tiom the 
STC ottset synthesis section 164 The audio out|jut tin> 
ing ot system stream It2 is detei mined by the ARTS 
described in the audio packet ol system stieam ^2. 
40157] Next, the STC switch timing contio! section 
166 obtains time T3 and T3'. at which the decoding oi 
the last video trame ot the matn signal anc the sub sig- 
nal ol system stream l»i reproduced tirsi is leimmaied. 
and switches the STC switches 162c and I62d to the 
output side of the STC offset synthesis section 164 at 
time T3 and T3' (step 168d). A method loi obtaining 
time T3 will t>e desciibed latei. Theiealiei. the STC 
value referred to by the video decoders 69c and 69d is 
piovided with an output from the STC offset synthesis 
section 164 The video decoding timing oi system 
stream t2 is determined by the VPTS desciibed in the 
video packet of system stream #2 

(0158] Next, the STC switch timing control section 
166 obtains time T4. at which the reproduction output ol 
the last video frame of system stream reproduced 
first is terminated, and switches the STC switch l62e to 
the output side of the STC offset synthesis section 1 64 
at time T4 (step I68e). A method for obtaining time T4 
will be described later. 

(0159] Thereafter, the STC value referred to by the 
video output switch 169 and the sub pictuie decodei 
159 is provided with an output from the STC offset syn- 
thesis section 164. The video output timing and sub pic- 
ture output timing of system stream #2 are detei mined 
by the VPTS and SPTS described in the video packet 
and the sub picture packet of system stream t2. 
(0160] When switching of the STC switches 162a 
through 162e is completed, the STC setting section 165 
sets the value given by the STC offset synthesis section 
164 in the STC 162 (Step 1681) (referred to as leload- 
ing of the STC 163) and switches all the switches I62a 
through I62e to be connected to the STC 163 (step 
I68g) 

(0161] Theieetter. the STC value retened to by the 
audio decoder 160. the video decoders 69c and 69d, 
the video output switch 169 and the sub picture decoder 
159 is provided with an output from the STC 163. and 
the operation returns to the ordinary operation. 
{0162} Now, TWO means for obtaining time Tl 
through T4 for switching the STC will be described. 
(0163] According to specific means, information 
representing time Tl through T4. which can be easily 
calculated when the streams are created, is recorded 
on the disk. The system control section 21 reads the 
information and sends the information to the STC switch 
timing control section 166. 

(0164] Especially tor T4. "VOB reproduction end 
time (VOB^E^PTM)' described in the DSI used for 
obtaining the STC offset is used as it is. 



|01 65] On the disk, the value obtained based on the 
81 C value used in system stream *n lepioduced tnst is 
desciibed. and the SIC switch timing contiol section 
166 switches the STC switches I62a thiough I62e at 
i the moment the value ot the STC 163 becomes time 1 1 
through T4. 

(Example 2) 

u [0166] In the first example, an example of applica- 
tion ot a system toi lepioducmg a plurality ot sti earns in 
synchronization accoiding to \he present invention is 
described in detail. In a second example, this system is 
applied to a i epi eduction conti ol system foi lepioducing 

75 two stieams seamlessly. In the case ol lecoidmg an 
MPEG signal, editing is conventionally perloimed on a 
GOP-by-GOP basis in general, and it is difficult by con- 
ventional methods to perform editing on a frame-by- 
frame basis. By using an MSS system accoiding to the 

PC present invention, substantial frame-based editing is 
realized. 

[0167] It is important to synchronize the timing of 
the video signal and the audio signal at the point of con- 
nection Specific synchronization systems will be 

25 described in third through ninth examples. 

[0168] The reproduction control system according 
to the present invention can be applied as follows to 
connect two streams while switching the two streams on 
a frame-by -frame basis seamle^y. As shown in Figure 

30 10, editing data 7St including synthesis information ot a 
28P zoom instruction signal and the like is processed by 
an editing data processing section 762 and sent to a 
switching synthesis section 763. The data is then 
switched/synthesized and output from a switching syn- 

3£ thesis signal output section 764. Thus, two MPEG video 
signals <:an be switched and connected seamlessly at 
an arbitrary point other than the borders between 
GOFs 

[0169] A system for synthesizing two pictures at an 
40 arbitrary p>oint based on an instruction signal will be 
described later with reference to Figure 22. 
[0170] In a simple switching mode, two pictures are 
simply switched over liame by frame at an ed it ir>g point 
as follows. Sti eam "e" and stream "b" are switched over 
45 at an editing point tc, and the resultant stream is output 
seamlessly. In a synthesis switching mode <such as a 
wipe), stream *'b" end stream "b" are switched after 
being synthesized from a start point ts to a termination 
point te. As shown in Figures 6 and SS, in mode l. 
so switching is performed from left to right; in mode 2, from 
center to periphery; in mode 3. top to bottom; and in 
mode 4. in a mosaic manner. Figure 6 is a simplified 
block diagram; and Figure 58 is a detailed block dia- 
gram. 

55 toi 71] In Figure 6. reproduction means 778. a divi- 
sion section 734. a VTS synchronization section 780. 
and MPEG decoders 728 and 730 have exactly the 
same structure as that of those in the 460F reproduc- 
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lion appaialijs shown in Figuie 3. and thus ihe 480P 
lepioduciion appaiatus can be used Wiih l eleience to 
Figuie 6. when an identHication intoimation processing 
section 766 delects lepioduction conltol intoimation 
766a. two video sti earns aie sent to the switching syn- 
thesis section 763. and the ttist stieam is switched to 
the second sti earn seamlessly at the connection point ts 
as desciibed above. 

[0172] With leieience to Figuie 58. when a 
720P/480P hieraichical lecoiding identiliei 725 having 
a high lesoiulion signal desciibed in the tiist example is 
detected, the synthesis section 732a pertoi ms calcula* 
tion and outputs a high lesolution signal such as a 480P 
oi 720P signal. 

[0173] When a 3D lecoiding identiliei 766c is 
detected a 3D signal piocessing section 7T0 generates 
a 3D video signal having a i ight-eye video signal and a 
left-eye video signal alternately interleaved, and outputs 
the signal. 

[0174] In this manner, the MSS system shown in 
Figuie 58. which uses two MPEG decoders or an 
MPEG decoder loi decoding two streams simultane- 
ously, can be used to provide three functions, i.e.. repro- 
duction control with frame- based editing, reproduction 
of a high resolution signal, and reproduction of a 3D 
video signal. 

101 75] Figure 1 1 shows a specif ic example of repro- 
duction control information 765. The reproduction con- 
trol information 765 includes a switching point number £ 
766. a synthesis mode identifier 767, a first stream 
switching start address ts 768. e first stream switching 
termination address t€2 769. a second stream GOP 
start address tsG 790. a second stream switching start 
address ts2 771 , and a second stream switching termi- 
nation address te2 , 772 in the order of the address 
used. 

10176] Specifically, when the switching point 
number 5=1 , es shown in part (9) o1 Figure 1 2, a picture 
synthesis identifier 767 is noi present or is 0. Accord- 
ingly, the first stream is simply switched into the second 
stream at the switching address of tsi-i. When S=2. as 
shown in part (10) of Figure 12. switching is started at 
tsl . and the two pictures of the f iist stream and the sec- 
ond stream are synthesized into one picture until t=1ei 
At t=teT . the first stream is completely switched into the 
second stream. 

[0177] With reference to the flowchart of Figure 13, 
a process for reproduction performed based on the 
reproduction control information will be described. 
f0178] With reference to part (i) of Figure 12, a 
GOP 781 a of the first stream and a GOP 781b of the 
second stream may be at discrete positions on an opti- 
cal disk without the streams being moved or rewritten. In 
this case, the time period for rewriting can be saved. 
With reference to part (3) of Figure 12, since data can 
be recorded on a DVD-RAM disk and the like after 
edited, streams are recorded on a GOP-byrGOP basis; 
i.e., a GOP 781 e and a GOP 781 f both including a 



tiame at the editing point are recorded adjacent to each 
othei In this case, the editing point is allowed to be 
changed in one GOP later. When two streams are syn- 
ihesired in a wipe manner, the picture of the first stream 
attei the editing point is required. Thus, the structure 
shown in part (3) ot Figure 12 is requited. 
10179] When S=0. i.e.. when synthesis of two pic- 
tur es is not performed, the data after the switching point 
tsl of a GOP 781 c is not required and thus istleleted as 

7.' shown in part (2) of Figure 12 to exclude the t edundant 
jx)rtion. Thus, the lecording efficiency is raised. How- 
ever, a GOP 781 d. which has the IN point, includes an i 
(intra) frame (i.e. basic frame) at the t>eginning. which 
cannot be deleted. Thus, a redundant portion 783 is 

I.', generated. 

(0180) As shown in step 792a in Figure 59. IGOP 
includes about 15 actual frames. When the B frames 
piesent before the IN p>oint are deleted as in step 792b. 
the number of frames is reduced from 12 in step 792a 

pf- (I edundant portion 783f) to 3 in step 792c (redundant 
portion 78 3g). The i edundant portion 783g is about 1/4 
of the redundant portion 783f. and thus the recording 
efficiency is raised. 

[0181] When this portion is reproduced, a B frame 
deletion identifier is detected in step 7921 The number 
of frames are calculated with a premise that fhe B 
frames are not recorded. Since an MPEG signal is 
decoded with only I. P frannes. the frames are decoded 
one after another in step 792g. The frame having the IN 

30 point (i.e.. t=ts2 ) is obtained by decoding arvj output. In 
this case, the number of frames to be processed is only 
three. Accordingly, the intended IN point can be repro- 
duced in a 1/4 time period. In this example, the redun- 
dant portion is 1/8 second long. As can be appreciated 

3t from Figure 59, ts2 is in the 14th frame in the worst 
case. In this case, the redundant portion is five frames 
long of I, P. P, P. B. i.e.. 1/3 x 1/2 = 1/6 second long, That 
is, the longest possible redurtdant portion is about 0.18 
second. At least such a time period is necessary to 

<o reproduce the IN point. Even if about five cut portions 
aie included in one second, each cut portion is*present 
every 0.2 second. By deleting the B frames by this sys- 
tem, the frame-based reproduction is realized even if 
there are five cut portions in one second. This means 

<t that this system is usable in the standard editing with no 
problem. 

|0182] A method for generating reproduction con- 
trol information will be described Where the final GOP 
before the OUT point is defined as a first GOP and the . 

f r first GOP after the IN point isdefined as a second GOP. 
reproduction control can be performed simply by 
r ecording the time of the beginning of the second GOP 
as the switching point ts2 and the time of the switching 
point. Alternatively, the number of frames from the 

£5 beginning of the second GOP to the switching point can 
be lecorded. 

[0183] When such reproduction control information 
is leproduced by a reproduction apparatus, the frame at 
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the switching point is decoded without piotessino the [ 
liames (pictures) among I. B. E. B. R B B. B. P. B. B B 
as shown in step 7921 in Figuie 59 In olhe> woids.. only 
I. P. P are decoded. In this mannei. the piciuie at the IN 
point is obtained in a 1/4 time penod as descnbed 
above. Even i1 theie are live trame switching points m 
one second, the redundant time period is U t8 second 
which is shorter than the pitch o1 the cut poilion {0 1' 
second). Thus, the data can be lepioduced seamlessly 
at all the switching points 

[0184] In ordei to realize synchionization. lepio- 
^uction control intonation is obtained by calculating the 
number o1 Irames (pictures) existing between the sec 
ond GOP and the sv^'itching point leased on the time o' 
the beginning o1 the second GOP and the time o1 the 
switching point. When the B liames which aie not nec- 
essary are deleted, the correction is periormed m con- 
sideration oi the deleted irames leleriing to an 
unnecessary frame deletion identiliei. Then. It can be 
found how many frames should exist between the start 
of reproduction of the second GOP. the IN point oi the 
second GOP, and the OUT point of the first GOP. m 
order to synchronize the OUT point of the first GOP and 
the IN point of the second GOP 

(0185] When the number of frames existing 
between the beginning of the second GOP and the 
switching point is recorded as the reproduction control 
information, correction in consideration of the unneces- 
sary frames such as the B frames can be periormed in 
order to f irxj the time to start decoding the second GOP 
lo realize the synchronization. 

(0186] Another recordable reproduction control 
information can be decoding start timing information 
which indicates a specified point in the first GOP at 
which decoding of the second GOP should be started in 
order to match the switching point of the first GOP and 
the switching |30int of the second GOP. 
{0187] In such a case, the switching points can be 
synchronized using only the reproduction control infor- 
mation, without pertorming any special calculation by 
the reproduction apparatus. 

(0188] The redundant portion 783 includes one i 
frame, a plurality of P frames and a plurality of B frames 
6y decoding these frames to create a frame immedi- 
ately before the frame corresponding the final editing 
point (i.e.. intraframe), the recording efficiency can fur- 
ther be raised. In the case of a DVD- RAM disk, the over- 
all editing structure is found as toe by recording the 
overall reproduction control information 765 and limited 
reproduction control information 765a on only the 
switching points, at two points, i.e.. at the beginning o* 
the recording data and immediately before the editing 
point as shown in parts (1). (2) and (3) of Figure 12 
Before the editing point, limited r^roduction controf 
information 765a on each separate editing point, foi 
example, S=l can be recorded among the overall reprc- 
duction control information. In this case, reproduction 
control for special reproduction is advantageously stabi- 
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lized 

(0189] A process toi lepioduclion contiol will lje 
descnbed. First, instep 774a. lepiodudion contiol infO'- 
mation is read. In step 774b. the lepioduction switching 
point number S is set to 0 In step 774c. S is incie- 
mented by one. The decoding start position oi the sec- 
ond stream needs to be specified In step 774d. it is 
checked whethei oi not i=ta . where t is the system 
clock or the VPTS of the fust stream and la is the decod- 
er ing start position information When t=ta . i e . when the 
VPTS of the second stieam leaches ta as shown in part 
<5) ot Figuie 12. the piocessmg advances lo step 774e. 
where MPEG-decoding of the GOP of the second 
stieam is started as shown in pail (6) of Figure 12 In 
IS step 774f . it is checked whethei oi not t=tsl . As shown 
in parts <5) and <6) of Figuie 12. the switching point ts2 
comes after the time corresponding to the value of 
<tsi-la)=(ts2-tsG) passes As shown by the expiession 
and parts (5) and (6) of Figure 12, the data at tsi of the 
pc^ first stream and data at ts2 of the secorxi stream are 
MPEG-decoded at the same time and output from the 
decodei. Parts (8) and (9) of Figure 12 show the state 
wheie the two streams are synchronized. Specific 
methods for synchronisation will be described in detail 
in the third through ninth examples. It is appreciated 
from the reproduction contiol information that tsi and 
ts2 are frame editing points of the two pictures. In step 
774g. it is determined whether or not there is a picture 
synthesis identifier 767. If the picture synthesis identifier 
30 767 does not exist, the processing advances to step 
774h. where the first stream is switched into the second 
sti earn by the switching synthesis section 763 (Figure 6) 
at the position of t=ts1 as shown in part (lO) of Figuie 
12. Since tstsi is the OUT point in actuality, the frame 
35 Of the first stream at t=tsi is not output. Since t=ts2 is 
the IN point, the frame of the second stream at this point 
is output. Since the frame information on the first stream 
is not necessary at l=t&2 . recording of such information 
can be omitted when 8=0. i.e.. when no picture synthe- 
<c sis is pei^rmed. In this case, the recording efficiency is 
raised by one P trame. Thus, reproduction control of the 
switching point toi 8=1 (simple switching mode) is com- 
pleted. The processing letuins to step 774c and deals 
with the switching point of 8=2. 
<e (0190] If n=0 in step 774 P. it is converted into n=l. 
In other words, when the second stream is decoded by 
the second MPEG decoder 730, the second stream, 
i.e.. the MPEG signal to be switched next is decoded by 
the first MPEG decodei 728. A different MPEG decoder 
sc is used from the case of S= 1 . 

[01 91 ) The second stream is decoded as shown in 
Figure 56. Input second streams 78ia. 781b. 781g. 
781 h and 781 i are sent by the division section 734 to 
the first MPEG decoder 728 and the second MPEG 
£f decoder 730 alternately and decoded into video signals 
788a and 788b. The video signals 788a and 768b are 
synthesized into one stieam by the switching section 
763. As is clear from the figure, the output from the first 
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MPEGdecodei 728 is slopped ahei the decoded video 
signal 788a is output. That is. the ptctuie is 1io?en This 
occuts since non* continuous data cannot t^e notmally 
decoded The MPEG decoding is lesumed b>' perioim- 
ing lesetting 790 oi legisteis and the like The second ^ 
MPEG decoder is processed similaiiy Conventionally, 
since only one MPEG decodei is used to pertorm seam- 
less lepioduciion. vanous complicaiec pie-piocessmg 
needs to be pertormed at the iime oi lecordmg. Accord- 
ing to the piesent invention, such vanous complicated 
processing is not necessaiy at the time of lecoiding loi 
the following leason. Since even if one of the MPEG 
decoders is stopped, the othet MPEG decodei can be 
used, even MPEG data which could not olherv^fise be 
connected seamlessly can be repioduced seamlessly. 7* 
While the second MPEG decodei operates, the first 
MPEG decoder is processed to resume operating. In 
this manner, seamless reproduction can be continued 
endlessly by svtfitching the two fv/lPEG decoders. Even 
frame-based editing of MPEG signals, vwhich conven- po 
tionally requires compricaled processing, can be leal- 
ized without complicated processing by using 
reproduction control according to the present invention. 
The system according to the present invention does not 
require the step of decoding and re-encoding MPEG 
data and thus provides a significant effect that the pic> 
ture quality is not deteriorated. 

[0192] The process for seamless repioduction can 
be summarized as follows. A plurality of streams are 
divided and alternately decoded by two MPEG decod- so 
ers. An output from one of the MPEG decoders is 
switched into an output from the other MPEG decoder 
at a switching point. While the other t\^PEG decoder is 
outputting data, the first MPEG decoder is reset to 
decode the next stream. At the next switching point, the ss 
output from the second MPEG decodei is switched into 
the output from the first MPEG decodei. 
[0193] Thus, continuous frame-based reproduction 
is realized. 

(Synthesis switching mode) 

[0194] Returning to step 774g of Figuie 13. a proc- 
ess for switching two streams while synthesizing the two 
streams into one picture in for example, a wipe manner, <f 
by the synthesis signal output section 764 (shown in 
Figure 6) will be described. In this case, the picture syn- 
thesis identifier 767 is not 0. In step 774i, the first 
stream is switched into the second stream as shown in 
part (n) of Figure 12 while the two streams are synthe- so 
sized from t=tsi . The switching is continued until the 
time becomes tstel or t=te2 instep774j. The switch- 
ing is completed in step 774k. Since the decoding of the 
first stream is stopped at t=tsl . wasteful decoding of 
data is prevented. The switching is performed from left 55 
to right as in the screen 782a in mode 1 . from center to 
periphery as in the screen 782b in mode 2. lop to bot- 
tom as in the screen 782c in mode 3. and in a mosaic 



mannei as in the scieen 782d m mode 4 
10195] Figuie 12 shows an example m which the 
oiiginal time stamp is not changed When the lecoidmg 
is perloimed using a DVD- RAM disk 01 the liKe where 
the time of the switching point of the first stieam 
matches the time of the switching point of the second 
stieam. the time stamp can be changed and thus the 
siiuctuie is furthei simplified. The time stamp can be 
changed at the time of lecording by setting tsi=ts2. In 
this case, the fitst stream can be lecorded up to tei. 
Time stamp tsG of the second stieam is changed to 
tsi -(ts2-lsG) . A time stamp having a smallei value than 
tsi is assigned. Time ta is identical with isG. Accord- 
ingly, v^en repioduction is pertoimed as shown in part 
(6) of Figuie 12. tsG. i.e.. the GOP stait address 770a 
of the secorKJ stieam is pre-iead based on the lepro- 
duction control information 765b shown in Figure 14, 
and decoding is stated at IsG. 

[0196] When a system of changing the time stamp 
is used, the time stamp of a GOP 761 e and the time 
stamp of a GOP 781f in part (3) of Figuie 12 are 
changed in the order and also overlapped with each 
other. When such a stream is reproduced, the reproduc- 
tion a^^aratus malfunctions. According to the present 
invention as shown in Figure 14, the GOP start address 
770a of the second stream is recorded in the reproduc- 
tion control information 765b. Thus, the positions of the 
time stamps which are changed in the order and also 
overlapped are found in advance. Therefore, malfunc- 
tion can be advantageously prevented even while fast- 
forwarding. Use of the GOP start address 770a further 
secures the switching into the second stream at the 
editing point. 

[0197] When the reproduction is performed as 
shown in part (6) of Figure 12. tsG, i.e., the GOP lead- 
ing address 770a of the second stream is pre-read 
based on the reproduction control information shown in 
Figure 14. and decoding Is started at tsG. 
|0i 98] Aliernatively. when information on the editing 
point tsi is available, the leading address tsG of the 
GOP including the editing point is pre-read and the data 
on the GOP 7811 of the second stream is MPEG- 
decoded at t^tsG . This provides an advantage that the 
editing point of the first stieam and the editing point of 
the second stream automatically match at tsi . 
[0199] By recording data with the time stamps 
being changed as above, the structure and operation 
can be significantly simplified. 

[0200] The above-mentioned second recording 
method will be described with reference to Figures 15 
and 16. 

[0201] With reference to Figures 6 and 16, an edit- 
ing/ieptoduction control information generation pro- 
gram will be described. As shown in Figure 6. editing 
information 780 including the IN and OUT points (edit- 
ing points) is input manually or based on data and 
sequentially converted into reproduction control infor- 
mation 765 by a reproduction control information gener- 
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atlon section 789. The lepiodudion coniicl mloimaiion 
765 IS once sloied in a memoiy 779 ond lecoided by 
lecoiding means 777 ot the HAM disK 724 liom ihe 
memoiy 779 eithei atiei all ihe editiny opeiaiion is com- 
pleted oi immediately beloie the disk is lemoved tiom 
the apparatus 

{0202] A piocess perioimed by the lepioduction 
control inioimation geneiation section 789 will be 
described in detail with leteienceto Figuie 16 
10203] In step 785a. the editing tnloimation 780 is 
input manually oi based on data sequentially S lepie* 
sents the numbei oi the editing point, and G lepiesents 
modes i through 4 in which two piaures aie switched 
while being synthesized by wipe oi the like tsO lepie- 
senls the start point oi Ihe lust stream, tsl lepiesents 
the OUT point ot the first stream, tei lepiesents the 
OUT synthesis completion point ot the first stieam. Is2 
lepiesents is the IN point oi the second stream. te2 lep- 
lesents the IN synthesis completion point oi the second 
stream, and tL2 is the OUT point oi the second stream. 
[0204] In step 785b. S=0 is set. S is incr emented by 
one (step 785c). and tsO and 1sl are read (step 785d). 
In step 785e, it is checked whether or not G exists. If G 
does not exist, there is no need to synthesize pictures, 
and thus in step 785f. the first stream (S) is i ecoided on 
the optical disk 724 tiom tsO to tsi The IN point ts2 of 
the second stream (S+i) is read, and the processing 
goes into a time stamp conversion routine (step 785g). 
In the time stamp conversion routine, the leading time 
stamp tsG of the leading GOP including information cor- 
responding to the frame corresponding to ts2. and the 
time stamp ts2 coiresponding to the final frame among 
the frames corresponding to the leading GOP are 
obtained. The value of the time stamp is reduced by the 
amount conesponding to (ts2-tsi) from tsG to tL2 of all 
the recoiding data of the second stream, thereby gener- 
ating a new time stamp. In step 785i, original address 
tsG to tL2 (t12) of the second stream is replaced with the 
new time stamp, and the information corresponding to 
the frame immediately following the frame correspond- 
ing to tsi (OUT point ot the first stream), is rewritten by 
the information obtained by the new time stamp, 
[0205] In step 785w, the address tsG of the leading 
GOP of the second stream is used 1c periorm the calcu- 
lation of ta=tsi-(ts2-tsG) so as tof ind the time period ta 
prior to the decoding of the second stream. The result- 
ant time period is added to the limited reproduction con- 
trol information 765a and the reproduction control 
information 765. In step 785j. limited reproduction con- 
trc- -^formation 765a only on the S number is recorded 
in i; ; secorxd half of the first stieam (S) as shown in part 
(2) of Figure 12. If S is terminated in step 785j. the 
ptocessing advances to step 785m; and if S is not ter- 
minated in step 785j. the piocessing returns to step 
785c to repeat the steps. In step 785m. the reproduc- 
tion control information 765 at all the editing points 
stored in the memory 779 is recorded m the reproduc- 
tion control information recording section of the optical 



disk, wheie management mtoimation such as TOG and 
the like aie i ecoided. as shown in part (3) of Figure 12. 
1hui ihe edilmg/iepioduction control information gen- 
eiation progiam is completed 

f 10206] If a synthesis identifier G exists, in step 
785n. lei (OUT synthesis completion point of the first 
stieam) is read In step 7B5p. the calculation of 
tG=tei -tsi IS peiiormed II lG<:tGniax in step 785q. the 
piocessing advances to step 785r. 11 tG>tGmax. the 

7f synthesis time period of the two streams is very long 
and exceeds the capacity ot the buffer of the reproduc- 
tion apparatus. In step 785v. an error message that 
decrease tei" is issued. When tei is changed in step 
785w. the piocessing letuins to step 785n. and tel is 

15 deci eased to be within the capacity. 

[0207] Thus, the synthesis of the connection point 
IS within the capacity. Accordingly, the processing 
letuins to step 785r. where the first stream is recorded 
on the optical disk fiom tsG to tel. In step 785s. ts2 of 

20 the second stream is read; and in step 78St, the time 
stamp conversion processing routine is performed in a 
similar manner to the step 78Sg. to convert the time 
stamp. In step 785u. the oiiginat address t^ to4f2 <tL2) 
of the second stream is replaced with the new time 

2S stamp, and the information corresponding to the frame 
immediately following the frame corresponding tei of 
the first stream is rewritten with the information obtained 
by the new stamp. Time ta is recorded in the memory. In 
step 785j. the limited reproduction control information 

30 7 65a is recorded In step 786k. it is checked whether or 
not processing for S=l through S=n is completed. In 
step 785m. the overall reproduction control information 
765 is recorded on the optical disk. Thus, all tlie opera- 
tions are completed. 

55 [0208] In this manner, the first stream is r-ecorded 
up tc a connection point, and a portion after the connec- 
tion point is lewritten with a time stamp having a smaller 
value of that of the connection point, so that the connec- 
tion ot the first stream and the connection point of the 
second stream match each other. Thus, the reproduc- 
tion apparatus can output a video signal including the 
two streams connected to each other on a frame-by- 
frame basis. 

{0209] In this case, two MPEG decoders are 
<e lequired. The recording and reproduction apparatus 
shown in Figure 6 includes the MPEG encoder 791 for 
f\/»P EG encoding the input video signal. Since an MPEG 
encoder is ne^^er used at the same time as an MPEG 
decoder and also the MPEG encoder has a processing 
£6 capability of twice or more of the MPEG decoder, one 
MPEG processing section has a function corresponding 
1c one encoder or two decoders. 

[0210] Accordingly, when the present invention is 
applied to the recording and reproduction apparatus 
£f including an MPEG encoder, the frame-t>ased editing is 
realized without adding any element. 
[0211] Soft-encoding/decodir>g performed by a 
CPU will be described. The capability of a CPU lor 
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encoding one stieam conesponds to the caj>abi!ity toi 
decoding two slieams At shown in Figuie 57. two 
streams can be decoded simultaneously oi m a time 
division mannei Thus, the viilual tjame based editing 
accoidtng to the piesent invention is leali^ed without 
laising the piocessmg cat^abiiity ot the CPU 
[0212] With lefeience to the llowchait o1 Figuie 57. 
a piocess loi pertoimmg encoding/decoding and 
lecoiding/iepioduction using a CPU will be described. 
In step 792a o1 encode lecotding. data o1 m= 1 totinal is 
input In step 792c and 792d. the m th video signal is 
input. The m th video signal is encoded to cieate an mth 
stream (step 792e) and lecoided on an optical disk 
(step 792f). H m is not linal in step 792g. the piocessing 
letuins to step 792c. it m is final in step 792g. the 
lecoiding is leimtnated (step 792h). In step 792i of 
lecoiding tepioduction control intormation. editing is 
performed on a iiame-by-frame basis, and the repro- 
duction control infoimation and the above-mentioned 
various identifiers are recorded on the optical disk (Fig- 
ures 6 and 58). 

[0213] Reproduction is performed as follows. The 
reproduction control program 792j is started. Cut point 
S is reproduced from i to final (steps 774b and 774c). 
As shown in steps 774m and 774e. two sti earns are 
MPEG-decoded simultaneously or in a time division 
manner at the frame-edited point. In step 774h. one 
decoded stream is switched to the othei decoded 
stream at t=ts . This operation is repeated until the final 
S is processed in step 774r. 

[0214] The CPU has a capability of MPEG-encod- 
ing one stream. This means the CPU has a capability o1 
MPEG-decoding two or three streams. Accordingly, one 
CPU can MPEG-encode one stieam. pertorms frame- 
based editing. MPEG-decodes two streams, and out- 
puts the connecied stieam seamlessly. The present 
invention has an effect that a part of the capability of the 
CPU which is not conventionally used is effectively 
used. 

(Example 3) ' 

[021 5] The MADM system accoiding to the pi esent 
invention simultaneously reproduce a plurality of 
streams. Synchronization sysiems are important. 
[0216] In the first exarrple, recording and reproduc- 
tion of high resolution video signals such as 480P and 
720P signals are described. In the second example, 
basic AV synchronization systems for reproduction con- 
trol using virtual frame-based editing are described. In 
the third through ninth examples, various methods o1 
synchronization will be described in more detail. 
[021 7] In the third example, sn operation of a repro- 
duction apparatus loi reading data from an optical disk 
having three compression video signals to be repro- 
duced simultaneously, and extending and reproducing 
the three compression video signals simultaneously by 
an AV synchronization system will be described. 



|02i8] FiQuie 37 shov^ a data structure ot an opti- 
cal disk used in the optical disk reproduction ap|3aratus 
in the thiid example 

10219] Video signals A. B and C are MPEG-com- 
f ptessed to obtain corrpression video streams A. B and 
C. 

[0220] The compression video streams A. B and C 
aie each packet ed in units of 2 KB into video packets. A 
packet headei of each packet includes a stieam ID for 
indicating which one of the compression video streams 
A thiough C IS stoied. When the packet stores a leading 
part ot the video tiame. the packet header also indudes 
a VPTS (video presentation time stamp) as video i pro- 
duction time infoimation indicating the time to lepio- 
r^ duce the fiame. In the third example, an NTSC signal is 
used as the video signal, and the video frame cycle is 
about 33 msec. 

(0221 ] On the optical disk, video packets created in 
the above -d esci i bed manner are grouped into, for 

po example, compression video signals A-1. B-1 and C-i 
each including an appropriate number of packets based 
on the data stored, and multiplexed. 
[0222] Figure 35 is a block diagram of an optical 
disk reproduction apparatus in the third example. 

Z'ii [0223] In Figuie 35. the optical disk reproduction 
apparatus includes an optical disk 501 described above, 
an optical pickup 502 for reading data from the optical 
disk 501 . signal processing means 503 for performing a 
series of signal processing such as binarization. 

30 demodulation, and error correction to the signal read by 
the optical pickup 502. a buffer memory 504 for tempo- 
rarily storing the data output from the signal processing 
means 503, division means 505 for dividing the data 
read from the buffer memory -504 into compression* 

55 video, signals, and reference time signal generation 
means 506 for generating a reference time signal 506 
including a countei (not shown) for counting 90 kHz 
clocks. Reference numerals -610. 520 and 530 repre- 
sent buffer memor ies for temporarily -storing the com- 

<C' pression video signals divided by the division means 
505. Reference numerals 511. 521 and 531 represent 
video decoders for extending and reproducing the com- 
pression video signals. Reference numerals 512. 522 
and 532 represent monitors for displaying the video sig- 

<f nals. 

[0224] Figur e 36 shows the structure of each of the 
video decoders 51 1 . 521 and 531 . 
[0225] As shown in Figure 36, the video decoder 
includes VPTS detection means 601 for detecting a 

50 VPTS stored in the packet header of the video packet, 
video extension means 602 for MP EG-ext eroding the 
compression video stream, and video reproduction tim- 
ing control means 603 for comparing the reference time 
signal and the VPTS and skipping or repeating the 

£f video reproduction on a frame-by-frame basis when the 
comparison result exceeds the threshold value. 
[0226] The optical disk r^roduction apparatus 
shown in Figure 35 operates in the following manner. 
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4€227J The optical pickup 502 i& tocu&-contic»lled oi 
tracking-contiolled by seivo means {noi t.hown) to lead 
a signal iiom the optical disk 501 and outijuti the signa! 
to the signal piocessing means 503 Ihc- signal 
processing means 503 subjects the signal to a senes ol 
processings including binanzation. deniodijlaiion. eiioi 
correction and the like Then, the signal piocessing 
means 503 stores the lesultant signal tn the bullei 
memory 504 as digital data. 

(0228] The bufle memory 504 lunctions so that 
even when the data supply tiom the optical disk 501 is 
temporarily stopped by. e.g.. a wan state, the data sup 
ply to the subsequent-stage sections is not stopped 
10229] The data lead tiom the butter memoi y 504 is 
divided into compiession video signals A thiough C by 
the division means 505 and output. The djviston means 
identifies which ol the compression video sti earns A 
thiough C is stored in each packet using the stieam ID 
in the packet header ol the packeted data, and detei 
mines the destination based on the identification result 
(O230] The divided compression video signals are 
respectively stored in bufiei memories 5lO thiough 530 
{0231] The buffer memories 510 thiough 530 act to 
continuously supply data to the video decoders 511 
through 531 . 

{0232] The video decoders 511 through 531 read 
data from the buffer memories 510 thiough 530 respec- 
tively, extend the compression video signals, and output 
the signals as video signals to the monitors 512 through 
532 respectively. 

{&233] With reference to Figure 36. operation of the 
video decoders 51 1 through 531 will be described. 
{1^34] The compression video signal read from the 
buffer memory is input to the VPTS detection means 
601 and the video extension means 602. 
{0235] The video extension means 602 MPEG- 
extends the corrpression video stream and outputs the 
video signal. 

{0236] The VPTS detection means 601 detects the 
VPTS ol the packet header and outputs the VPTS. 
{0237] The video reproduction timing control means 
B03 receives the video signal output from the video 
extension means 602. a reference time signal and the 
VPTS output from the VPTS detection means 601 , and 
compares the reference time signal and the VPTS. 
Then the difference between the two exceeds the 
threshold value, the video reproduction timing is control- 
led so that the difference between the VPTS and the ref 
erence time signal is equal to or less than the threshold 
value. 

{0238] In the third example. 33 msec is used as the 
threshold value for video reproduction. The video repro- 
duction timing control means 603 performs the follow- 
ing. 

(reference time signal-VPTS)>33 msec.:l frame is 
skipped. 

(reference time signal>VPTS)<-33 msec.:l frame is 



lepeated 

10239] In the thud example, due to the piecision 
enoi of the crystal oscillatoi used in the leleience lime 
signal oeneration means 506 and the video decoders 
511 thiough 531. the video decoders 5il and 531 ate 
slowei and the video decodei 521 is fastei m teims of 
extension and leproduction lelative to the ieleieix:e 
time signal. Unless reproduction timing is adjusted, the 

^( reproduced video signals ate out of synchronization 
[0240] Figui e 38 IS a timing diagram of video i epi o- 
duction in the thud example. Part (a) ol Figuie 36 shows 
the reference time signal with lespect to reproduction 
time t. Pan (b) shove's the VPTSsA. which is a VP1S of 

It the compiession video signal A to be extended by the 
video decodei 511. part (c) shows the VPTS^rE. which 
is a VPTS of the compiession video signal B to be 
extended by the video decoder 521 . and part (d) shows 
the VPTS#C. which is a VPTS of the compi ession video 

PC signal C to be extended by the video <lecoder 531 . 

[0241] The video decoder 511 continues extension 
and reproduction of the compression vkdeo signal A. 
and the difference between the VPTS#A and the refer- 
ence time signal exceeds 33 msec as the threshold 

25 value at Ti. Accordingly, the video reproduction timing 
control means oi the video decoder 511 skips one 
frame, which is originally to be reproduced, to adjust the 
reproduction timing so that the difference between the 
VPTS#A and the reference time signal is equal to or 

so less than the threshold value. 

[0242] The video decoder 521 continues extension 
and reproduction of the corrpression video signal B. 
and the differerrce between the VPTS#B and the refer- 
ence time signal exceeds -33 msec, as the threshold 

55 value at T2. Accordingly, the v'rdeo reproduction timing 
control means of the video decoder 521 reproduces one 
frame in repetition, which has been already reproduced, 
to adjust the reproduction timing so that the difference 
between the VPTS^B and the reference time signal is 

<o equal to or less than the threshold value. 

t0243] Similarly, the video decoder 531 continues 
extension and reproduction of the compression video 
signal C. and the difference between the VPTS#C and 
the refere?nce time signal exceeds 33 msec, as the 

<5 threshold value et T3. Accordingly, the video reproduc- 
tion timing control means of the video decoder 531 
skips one frame, which is originally to be reproduced, to 
adjust the reproduction timing so that the <jifiererx;e 
between the VPTS^C and the reference time signal is 

56 equal to or less than the thresfiotd value. 

[0244] As described above, in the third example, 
when the difference between the reference time signal 
and the VPTS detected by each video decoder exceeds 
the threshold value, the video reproduction timing con- 
£f trol means of each video decoder performs adjustment 
so that difference between the reference time signal and 
the VPTS does not exceed the threshold value In this 
manner, the video signals reproduced by vioeo decod- 
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eis can be synchionized with one anolhei 
(Example 4) 

(0245] The louith example i elates to a tepioduclion 
apparatus lor adjusting a leleience time signal using 
audio repioduction time inioi mation indicating the lime 
to leproduce the audio signal and synchronizes a plural- 
ity ol video signals based on the leleience time signal. 
[0246] Figuie 41 shows a data stiucture ol an opti- 
cal disk used in an optical disk lepioduction apparatus 
in the fourth example. The optical disk includes com- 
pression audio data in addition to the data included in 
the optical disk used in the thiid example. 
[0247] An audio signal is audio-tramed in units of 3? 
msec, for compression to obtain a compiession audio 
stream. The audio stieam is packeted in units of 2 kB 
into audio packets and lecotded on the optical disk. A 
packet header of each audio packet includes a stream 
ID for indicating that the stored data is a compression 
audio stream. When the packet stores a leading part c1 
the audio frame, the packet header also includes an 
ARTS <audio presentation time stamp) as audio repro- 
duction time information indicating the lime to repro- 
duce the frame. 

[0248] Figure 39 is a block diagram of the reproduc- 
tion apparatus in the fourth example. 
[0249] Elements 501 through 532 are the same as 
those shown in Figure 35 in the third example. 
[0250] Reference numeral 504 represents a buffer 
memory for temporarily storing the compression audio 
signal. Reference numeral 541 represents audio exten- 
sion means for extending the compression audio signal. 
Reference numeral 542 represents a speaker for repro- 
ducing the extended audio signal. 
[0251] Figure 40 shows a structure of the audio 
decoder 541. The audio decoder 541 includes APTS 
detection means 701 for detecting the APTS stored in a 
packet header of the audio packet, and audio extension 
means 702 for extending the compression audio 
stream. 

[0252] An operation of the optical disk reproduction 
apparatus shown in Figure 39 for reproducing the opti- 
cal disk shown in Figure 41 will be described. 
[0253] The operation until the signal is input to the 
division means 505 is similar to that with the optical disk 
reproduction apparatus in the third example. 
[0254] The data read from the buffer memory 504 is 
divided into compression video signals A through C and 
a compiessiori audio signal by the division means 505 
and output- The division means 505 identif ies which of 
the compression video signals A through C and the 
compression audio signal is stored in each packet with 
the stream ID in the packet header of the packeted data, 
and determines the destination based on the identifica- 
tion result. 

[0255] The divided compression video signals and 
compression audio signal are temporarily stored in 



butler memories 510 thiough 540 lesj^ectively 
{0256] The video decoders 5ii through 531 lead 
data from the buffet memories 510 through 530 respec- 
tively, extend the corntDiession video signals, and output 

5 the signals as video signals to the momlois 51 2 thi ough 
532 lespectively The audio decodei 541 leads data 
liom the buffer memory 540. extends the compression 
audio signal, and outputs the signal as an audio signal 
through the speakei 542. 

10 [0257] The operations ol the video decoders 511 
thiough 531 toi extending the compiession video sig- 
nals and lor adjusting the synchronization when the dit- 
feience between the refeience time signal and the 
VPfS exceeds the thieshold value aie the same as in 

7* the thiid example. 

[0258] The compiession audio signal i ead from the 
buffer memory 540 is input to the audio decoder 541 . 
The APTS detection means 701 detects and outputs the 
APTS- The audio extension means 702 extends the 

20 compression audio stream and outputs the audio signal. 
[0259] The APTS signal output from the audio 
decoder 541 is input to the reference time signal gener- 
ation means 506, and the reference time signal is 
adjusted by the APTS. 

[0260] In the fourth example, due to the precision 
error of the crystal oscillator used in the reference time 
signal generation means 506. the video decoders 511 
through 531 and the audio decoder 541 . the reference 
time signal is faster in terms of extension and reproduc- 
56 tion relative to the audio decoder 541. The video 
decoder 511 is slower and the video decoder 521 is 
faster in terms of extension and reproduction relative to 
the reference time signal. Unless the reproduction tim- 
ing is adjusted, the reproduced video signals and audio 
35 signal are out of synchronization. 

[0261] Figure 42 is a timing diagram of audio repro- 
duction in the fourth example. Part (a) of Figure 42 
shows the APTS with respect to repioduction time t. 
Part (b) shows the reference time signal. Part (c) shows 
40 the VPTS#A, at which the compression video signal A 
to be extended by the video decoder 51 1 is to be repro- 
duced, and part (d) shows the VPTS^fB. at which the 
compi ession video signal B to be extended by the video 
decoder 512 is reproduced. 
<5 [0262] Figure 42 does not show the VPTS#C. at 
which the compression video signal C to be extended by 
the video decoder 531 , but the diagram is almost the 
same as in Figure 38 shown regarding the third exam- 
ple. 

BO [0263] The reference time signal generation means 
506 is adjusted using the APTS at time when the APTS 
shows tal and ta2, and the reference time signal is 
teset as tal and ta2 at the respective lime. 
[0264] The video decodei 51 1 continues extension 

£; and reproduction of the compression video signal A, 
and the difference between the \/PTS#A and the refer- 
ence time signal exceeds 33 msec, as the threshold 
value at T4. Accordingly, the' video reproduction timing 
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contiol means ol ihe video deccKiei 5ii skips one 
liame. which is oi ipinally 1o be lepioduced. to adjust the 
lepiodudion timing so thai the dilleience iDelween the 
VPTSi?A and the leieience lime signal li equal to oi 
less than the ihieshold value 

{0265] The video decxxjei 521 continues extension 
and repioduction oi the compiession video siona! B. 
and the ditleience between the VPIS^^B and the letei- 
ence lime signal exceeds -33 msec as the thieshold 
value at T5 and T6 Accordingly, the video lepiodudion 
timing contiol means oi the video decodei 52i lepio- 
duces one tiame in lepeiition. which has been alieady 
I eproduced. to adjust the i epi oduction timing so that the 
difleience t>etween the VPTS^iB and the leleience time 
signal is equal to oi less than the thieshold value. 
{0266] As desciibed above, in the fouith example, 
when the diHeience between the leieience time signal 
and the VPTS detected by each video decoder exceeds 
the threshold value, the video reproduction timing con- 
trol means oi each video decodei perlorms adjustment 
so that difleience between the leference time signal and 
the VPTS does not exceed the threshold value. In this 
manner, the video signals reproduced by video decod- 
ers can be synchronized with one another 
(0267] Regarding the diflerence between the reler- 
ence time signal and the APTS. the APTS is not 
adjusted using the releience time signal but the reler- 
ence time signal is adjusted using the APTS. Accord- 
ingly, audio and video signals are synchronized with no 
unnaturalness in the audio output. 

(Example 5) 

[0268] The lifth example relates to a reproduction 
apparatus lor adjusting the reference time signal using a 
VPTS detected by one video decoder and synchroniz- 
ing a plurality oi video signals based on the relerence 
time signal. 

t0269] Figure 43 is a block diagram ot an optical 
disk reproduction apparatus in the titih example. 
[0270] Elements 501 through 532 are the same as 
those in the third example. Relerence numeral 551 rep- 
resents a video decodei used in the fifth example 
f0271) The video decoder 55i has a function of out- 
putting the detected VPTS. Figure 44 shows a structure 
of the video decoder 551 . 

[0272] The video decoder 651 includes VPTS 
<3etection means 801 for detecting a VPTS indicating 
the reproduction time of the video signal multiplexed as 
the compression video signal and video extension 
means 802 for extending the compression video signal 
[0273] In the filth example, due to the precision 
error of the crystal oscillator used in the reference time 
signal generation means 606 and the video decoders 
521. 631 and 551. the reference time signal is faster in 
terms of extension and repioduction relative to the 
video decoder 551. The video cecodei 52i is siowei 
and the video decoder 531 is faster in terms of exten- 



sion and lepi oduction relative to the reference time sig- 
nal Unless lepiodudion timing is adjusted, the 
lepioduced video signals aie out of synchronization. 
(0274] Figui e 45 is a timing diagram of video output 

f in the fifth example Part (a) of Figure 45 shows the 
VP1S??A detected by the video decoder 551 with 
lespect to leproduction time t. Part{b) shows the refer- 
ence time signal. Part (c) shows VPTS#B. at which the 
compi ession video signal B to be exterxJed by the video 

ic decodei 521 is to be r epi oduced. and part (d) shows the 
VP! S^C. at which the conpr ession video signal C to be 
extended by the video decoder 531 is to be reproduced. 
10275] The I elerence time signal generation means 
506 is adjusted using the VPTS* A at time when the 

7£ VPTS^/A shows tvi and tv2. and the reference time sig- 
nal is leset as tvi and tv2 at the respective time. 
[0276] The video decoder 521 <x>ntinues extension 
and repioduction of the compression video signal B. 
and the difference between the VPTS#B arxl the refer- 

po ence time signal exceeds 33 msec, as the threshold 
value at T7. Accordingly, the video reproduction timing 
contiol means of the video decoder S21 skips one 
frame, which is originally to be r.epM'Oduced. to adjust the 
reproduction timing so that the difference between the 

P5 VPTS^rB and the reference time signal is equal to or 
less than the threshold value. 

[0277] Similarly, the video decoder 631 continues 
extension and reproduction of the compression video 
signal C. and the difference between the VPTS#C and 

30 the lefeience time signal exceeds -33 msec, as the 
threshold value at T8 and T9. Accordingly, the video 
repioduction timing control means of the video decoder 
531 reproduces one frame in repetition, which has been 
already reproduced, to adjust the reproduction timing so 

5£ that the difference between the VPTS#C and the refer- 
ence time signal is equal to or less than the threshold 
value. 

[0278] As described atx)ve. in the fifth example, 
when the difference between the reference time signal 

<o and the values of VPTSs detected by the video decod- 
ers 521 and 531 exceeds the threshold value, the video 
repioduction timing control means of aach video 
decoder performs adjustment 'SO that the difference 
between the reference time -signal and the VPTS does 

<£ not exceed the threshold value. 

[0279] By adjusting the reference time signal using 
the VPTS#A detected t)y the video decoder -551. the 
video signal reproduced by the video decoder 561 is not 
accompanied by any unnaturalrtess in the visual output 

so despite the frame-by-frame skipping or r^eat of the 
reproduction. Thus, the video signals can be syr>chro- 
nized with one another. 

(Example 6) 

[0280] The sixth example relates to a reproduction 

apparatus including a plurality of video decoders for 
extending and reproducing a compression video signal. 
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Each oi the video decodei s mcludet leieience time sig- 
nal generaiion means The lepioduciion apparatus, 
adjusts the teieience time signal ot each video decodei 
using an APTS indicating the lime to lepioduce an 
audio signal to realise synchioni?ation 
|0281] In the sixth example, the optical disk shown 
in Figuie 41 is used. 

10282] Figuie 46 is a block diagiam of an optical 
disk tepioduction appaiatus m the sixth example. 
(0283] Elements 501 thiough 542 ate the same as 

those shown in Frgure 39 m the lourth example. Unlike 
the lepioduction appaiatus shown in Figuie 39, the 
lepioduciion appaiatus in this example does not have 
leteience time signal genei alien means 506 independ- 
ently, but each video decodei 561 thiough 58i has lel- 
eience time signal geneiation means. 
[0284] Relet ence numeial 561 lepiesents a video 
decodei toi extending and leproducing compression 
video signal A. lelerence numeral 571 represents a 
video decoder lot extending and lepioducing compres- 
sion video signal B. and relet ence numeral 581 repre- 
sents a video decoder tot extending and reproducing 
compression video signal C. 

[0285] Figute 47 shows a structure of each o1 the 
video decoders 561 thiough 581 used in the sixth exam> 
pie. 

{0286] The video decodei includes VPTS detection 
means 901 lor detecting a VPTS indicating the repro- 
duction time of the video signal multiplexed as the com- 
pression- video signal, video extension means 902 tor 
extending the compression video signal, and video 
I eproduction timing control means 903 toi comparing 
the relet ence time signal and the VPTS and skipping or 
repeating the video reproduction on a frame-by-lrame 
basis when the compaiison result exceeds the thresh- 
old value, and reference time signal generation means 
904 tor generating the reference lime signal. 
[0287] In the sixth example, the reference time sig- 
nal of leteience time signal generaiion means 904 
included in each of the video decodeis 561 through 581 
is adjusted using the APTS detected by the audio 
decode? 641. 

[0288] Since the lefeience time signals are 
adjusted using the same APTS. the reference time sig- 
nals generated in the video decoders 561 through 581 
show the same value after being adjusted. 
[0289] After the adjustment using the APTS. as in 
the lourth example, when the difference between the 
reference time signal and the values of VPTS detected 
by each video decoder exceeds the threshold value, the 
video reproduction timing control means of each video 
decodet performs adjustment by skipping or repeating 
the reproduction on a f tame-by-frame basis so that dif- 
ference between the reference time signal and the 
VPTS does not exceed the Ihteshold value. 
[0290] As described above, in the sixth example, 
the tefetence time signal generated in each video 
decodet is adjusted using an APTS. and the video 



lepioduction liming control means ot each video 
decodei maintains the dHlerence between each refer- 
ence lime signal and each VPTS to be equal to or less 
than the thieshokJ value. Thus, the video signals can be 

f synchionized with one another. 

[0291] As in the fourth example, the audio signal 
and the video signal can be syrw:hroni2ed without pro- 
viding any unnaturalness in the audio output. 
10292] In the sixth example, the reference time sig- 

if nals in the video decoders 561 through 581 are 
adjusted using the APTS detected by the audio decodet 
541 The video stgnals can be reproduced in synchroni- 
sation in a simllat manner by using one of the video 
decodeis shown in Figure 44 tn the fifth example and 
adjusting the lefeience time signals of the other video 
decoders using the VPTS detected by the one video 
decodei. 

(Example 7) 

[0293] The seventh example relates to a reproduc- 
tion apparatus fot simultaneously reproducing two com- 
pression video signals. The two compression video 
signals are obtained by dividing a 3D signal into a tight- 
eye video signal and a left-eye video signal and com- 
pressing the divided video signals. 
(0294] The overall structure of the apparatus is gen- 
erally similar to that of the optical disk reproduction 
apparatus shown in Figure 46 in the sixth example, but 

30 the reproduction apparatus in the seventh example 
includes two video decoders for^xtending compression 
video signals obtained after the division means 505 
since two video signals are to be reproduced simultane- 
ously. Figute 48 shows a structure of one of the video 

35 decoders used in the seventh exannple. and Figure 49 
shows a structure ot the other video decoder used in the 
seventh example. 

[0295] As shown in Figure 48. the video decoder 
includes VPTS detection means 1001 tor detecting a 

<o VPTS indicating the reproduction time of the video sig- 
nal multiplexed as the compression video signal, video 
extension means 1002 for extending the MPEG com- 
pjession video signal, reference time signal generation 
means 1004 for generating a reference time signal, and 

<£ video reproduction timing control means 1003 for com- 
pat ing the reference tinr^ signal arxJ the VPTS and skip- 
ping or repeating the video reproduction on a frame-by- 
ftame basis when the comparison result exceeds the 
threshold value and also for outputting a horizontal syn- 

Bc Chi onization signal and a vertical synchronization signal 
for the video to be reproduced. 

[0296] As shown in Figure 49. the other video 
decoder includes VPTS detection means 1101 for 
detecting a VPTS indicating the reproduction time of the 
££ video signal muttiplexed as the compression video sig- 
nal, video extension means 1102 for extending the 
MPEG comptession video signal, reference time signal 
generation means 1104 for generating a reference time 
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signal, and video lepioduclion liming contiol meaiii 
1103 lor comparing the leJeience lime- signal and the 
VPTS and skipping oi lepeating ihe video tepioductton 
on a liame-by-lrame basis when the conipanson lesult 
exceeds the ihteshold value, leceivmg the honrontai 
synchiontzation signal and the vertical synchioniralion 
signal toi the video to be tepi educed, and also lepio- 
ducing the extended video signal in synchionization 
with the horizontal/vertical synchionization signals. 
{0297) The video decoders aie connected to each 
olhei so that the honzontal synchionization signal and 
the vertical synchronization signal output tiom the video 
decoder in Figure 48 are sent to the video decodei in 
Figure 49. 

[0298] In the optical disk repioduclion appaiatus in 
the seventh example having the above-desci ibed stiuc- 
tuie. the reference time signal generated by each video 
decoder lor the right or left eye is adjusted using an 
APTS. and the video reproduction timing contiol means 
of each video decodei maintains the difference between 
each reference time signal and each VPTS to be equal 
to or less than the threshold value Thus, the right-eye 
video signal and the left-eye video signal can be syn- 
-chronized with one anothei on a trame-by-frame basis 
"By using the horizontal and vertical synchronization sig- 
nals output by one o1 the video decodei as the horizon- 
tal and the vertical synchronization signals of the other 
video decoder, two video signals can be reproduced in 
synchronization on a pixel-by-pixel basis. 
{0299] In the seventh example, compression video 
signals obtained Irom a 3D video signal are used and 
divided into the right-eye and left-eye video signals. 
Alternatively, for example, an original video signal hav- 
ing a first resolution is divided in a vertical and/or hori- 
zontal direction into at least two video signals including 
a first video signal and a second video signal having a 
second resolution which is lower than the first resolu- 
tion. The resultant signals are compressed to be used 
Thus, a plurality of video signals in synchronization with 
one another on a pi xel-by -pixel basis can be obtained 
as Irom a 3D video signal. By synthesizing such result- 
ant signals, the clear original video signal having the 
original resolution is reproduced. 

(Example 8) 

{O3O0] The eighth example relates to an optical disk 
reproduction apparatus for extending one compression 
video signal and two corrpression audio signals and 
reoroducing the signals simultaneously. 
[C» 31] Figure 52 shows a data structure of the opti- 
ca* disk used in the eighth example. 
[0302] Two audio signals D and E are compressed 
to obtain compression audio streams D and E. A video 
signal is conrpressed to obtain a compression video 
stream. 

(0303] The compression video streams D and E 
and the compression video stream are oacketed in units 



ot 2 kB into audio packets and video packets A packet 
header of each packet includes a stieam ID lor indicat- 
ing vjhich of the compiession audio s1ieami> D and E 
and the compression video stieam is stored, and the 
APTS and VPTS desci ibed above 
10304] Figure 50 is a block diagram of a lepioduc- 
tion apparatus in the eighth example. 
10305] The lepioduction appaiatus has a geneially 
similar structure to thai in Figuie 39 m the fourth exam- 
pie The audio decodei 541 has the same stiuctuie as 
that shown in Figure 40. and the video decodei 531 has 
the same structure as that shown in Figure 36 The 
audio decoder 591 has the same stiuctuie as that 
shown in Figuie 51. 
7^ 10306] Reference numeial 590 lepiesents a butfei 
memory for tempoiarily sloiing the compiession audio 
signal like the buffer memory 540. f^eference numeral 
592 lepresents a speakei for reproducing the audio sig- 
nal. 

pc^ (0307] Figure 51 shows a structuie of the audio 
decoder 591 . 

[0303] The audio decoder 591 includes APTS 
detection means 1201 for detecting an APTS of an 
audio signal multiplexed as a compression audio signal. 

P5 audio extension means 1202 for extending the com- 
pression audio signal, and audio reproduction timing 
control means 1203 for comparing the reference lime 
signal and the APTS and skipping or repeating the 
audio reproduction on an audio frame-by-audio frame 

30 basis when the comparison result exceeds the thresh- 
old value. 

[0309] A reproduction operation in the eighth exam- 
ple will be described. 

[0310] The operation until the signal r-ead from the 
5f optical disk 501 is input to the division means S05 is 
similar to that in the other examples. 
[031 1 ] The data read from the buffer memory 604 is 
divided by the division means 505 into a compression 
video signal, the compiession audio signal O and the 
<o compression audio signal E» arti output. The division 
means 505 identifies which of the compression video 
signal, the compression audio signal D and the com- 
piession audio signal E is stoied in each packet using 
the packet ID in the packet header of the packeted data. 
45 and determines the destination based on the identifica- 
tion result. 

[0312] The divided compression video signal, the 
compression audio signal D and compr ession audio sig- 
nal E are temporarily stored in buffer memories 530, 

sc 540 and 590 respectively. 

[0313] The video decoders reads data from the 
buffer memory 530. extends the compression video sig- 
nal and outputs the signal as a video signal to a monitor 
532. The audio decoders 541 and 591 read data from 

5£ the buffer memories 540 and 590. extend the compres- 
sion audio signals and output the signals as audio sig- 
nals through the speakers 542 and 592. 
[0314] The reference time sigr^t generated by the 
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leleience lime signal geneiation means 506 is. adjusted 
by an APTS^D delected by the audio decodei 541 
10315] In the audio decode: 59i. an APTS^E is 
detected by the APIS detection means I20i and the 
compression audio signal E is extended by the audio 
extension means 1202. The audio lejDioduction timing 
control means 1203 leceives the extended audio signal 
output tiom the audio extension means 1202. the lelei- 
ence time signal, and the APlSi?E tiom the APTS 
detection means 1201. and compaies the leieience 
time signal and the AP1S??E. When the ditieience 
between the releience time signal and the AP1S*?E 
exceeds the threshold value, the audio lepi eduction 
timing contiol means 1203 contiols the audio lepi educ- 
tion timing so that the diltei ence is equal to oi less than 
the threshold value. 

[0316] In the eighth example. 32 msec is used as 
the threshold value. The audio repi eduction timing con- 
trol means 1203 perlotms the loltowing. * 

(reference time signal-APTS#E)>32 msec.:l audio 
frame is skipped. 

(reference time signal-APTS*E)<-32 msec.:! audio 
frame is repeated. 

10317] The operation of the video decodei 531 lor 
extending the compression video signal and performing 
adjustment when the difference between the reference 
time signal and the VPTS exceeds the threshold value 
are similar to those in the third example. 
{0318] In the eighth example, due to the precision 
error of the crystal oscillator used in the reference time 
signal generation means 506. the video decoder 531 . 
and the audio decoders 541 and 591 ; the audio decod- 
ers 541 and 591 are slower and the video decoder 531 
is faster in terms of extension and reproduction relative 
to the reference time signal. Unless reproduction timing 
is adjusted, the reproduced video signals are out of syn- 
chronization. 

[0319] Figure 53 is a timing diagram of video repro- 
duction in the eighth example. Part (a) of Figure 53 
shows the APTS*D with respect to reproduction time 1. 
Part (b) shows the reference time signal, part (c) shows 
APTS*E. al which the compression audio signal E to be 
extended by the audio decoder 591 is to be reproduced, 
and part (d) shows the VPTS. at the compression video 
signal to be extended by the video decoder 531 is to be 
reproduced. The reference time signal is adjusted using 
the APTS^D when APTS^D shows ta3 and ta4. The ref- 
erence time signal is reset to taS and ta4 at the f espec- 
tive time. 

[0320] The audio decoder 591 continues exiension 
and reproduction of the compression audio signal E. 
and the difference between the APTS^fE and the fetei- 
ence time signal exceeds 32 msec, as the threshold 
value at TlO. Accordingly, the audio reproduction timing 
control means 1203 o1 the audio decoder 591 skips one 
audio frame, which is originally to be reproduced, to 
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adjust the lepi eduction timing so that ttie ditfeience 
between the APTS?E and the lefeience time signal is 
equal to oi less than the thieshold value 
[0321] The ditfeience between the VPTS and the 

5 I efei ence time signal exceeds -33 msec as the thiesh- 
old value at 11 1 and ^^2. Accoidmgly. the video repro- 
duction timing control means of the video decodei 531 
reproduces one liame in repetition, which has been 
already reproduced at the lespective time, to adjust the 

rf> reproduction timing so that the ditfeience between the 
VPTS and the leteience time signal is equal to or less 
than the threshold value. 

[0322] As described above, in the eighth example, 
when the ditfeience between the lefeience time signal 

15 and the APTS*fE detected by the audio decodei 591 
exceeds the thiesliold value, the audio repi eduction 
timing control means of the audio decoder performs 
adjustment so that difference between the reference 
time signal and the APTSnE does not exceed the 

.10 threshold value of audio reproduction. Similarly, differ- 
ence between the reference time signal and the VPTS 
is adjusted so as not to exceed the threshold value of 
video reproduction. In this manner, each audio signal 
and the video signal can be synchronized with one 

25 another. 

(Example 9) 

[0323] In the ninth example, the clock for perform- 
30 ing extension is changed for audio reproduction timing 
control - 

[0324] The overall structure and operation oi the 
reproduction apparatus in the ninth example are gener- 
ally similar to those of the optical disk reproduction 
5£ apparatus in the eighth example, but the operation of 
audio reproduction timing control performed when the 
reference time signal and the APTS^E exceeds the 
threshold value is different from that of the eighth exam- 
ple. With refeience to Figure 54 and 55. audio reproduc- 
er/ tion timing contiol used in the ninth exanpte will be 
described. 

[0325] Figute.54 shows an operation when the dif- 
ference between the APTS^E and the reference timing 
signal exceeds 32 msec, which is the threshold for the 

45 audio reproduction. Part (a) of Figure 54 shows the ref- 
erence time signal with respect to reproduction time t. 
Part (b) shows the APTS#E, and part (c). shows the 
clock frequency at which the audio decoder 591 per- 
forms extension and reproduction. Ordinary extension 

50 and reproduction are performed by clock fO having a fre- 
quency which is 384 times the sampling frequency fs of 
the audio signal The difference between the APTS#E 
and the reference time signal exceeds 32 msec, at time 
Tn. and accordingly, audio reproduction control means 

55 switches the clock fO to f 1 . The frequency of clock f 1 is 
higher by iO% than the frequency of clock fO. Exiension 
performed with clock f l proceeds faster than extension 
performed with clock fO by 10%. With clock f1, the 
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wheie Ihe ditleience between the API £>?fE and tlie lel- 
eience lime sipnal exceeds 3? m^ec which is the 
ihieshold value Thus, ihe lepioduclion liming is 
adjusted so thai the ditleience between the APTS*?E 
and the letei ence time signal is equal to oi less than the 
thieshold value. 

(0326] Figure 55 shows an opeiation when the dil- 
feience between the APTS#E and the leteience timing 
signal exceeds -32 msec, which is the threshold loi the 
audio repioduction. Part (a) o1 Figuie 55 shows the let- 
eience lime signal with lespecl to lepioduction time 1 
Part (b) shows the APTSi?E. and par: (c) shows the 
clock tiequency at which the audio decodei 591 pei- 
lorms extension and lepioduction. 
(0327] The ditleience between the APTS*E and the 
leterence time signal exceeds -32 msec, at time Ti2, 
and accordingly, audio reproduction control means 
switches the clock fO to 12. The irequency ot clock 12 is 
lower by 10% than the Irequency o1 clock 10. Extension 
perioimed with clock 12 proceeds moie slowly than 
extension performed with clock 10 by 1 0%. With dock 12. 
the extension is perlormed lor 320 msec liom the point 
vtfhere the ditleience between the APTS^fE and the rel- 
erence time signal exceeds -3? msec which is the 
thieshold value Thus, the reproduction timing is 
adjusted sc that the diflerence between the APTS#E 
and the reieience time signal is equal tooi less than the 
threshold value. 

(0328] As described above, when the diHerence 
between the APTS#E and the relerence time signal 
exceeds the threshold value lor the audio reproduction, 
the clock by which the signal is extended is changed so 
that the extension is performed at a higher speed or 
lower speed than the normal speed. By such an opera- 
tion, the reproduction timing is controlled so that the dil- 
lerence between the APTS#E and the relerence time 
signal is equal to oi less than the threshold value. Thus, 
the audio signals and the video signal can be repro- 
•duced in synchronization with no unnaturalness in the 
audio outpui 

{0329] In the ninth example, the liequency oi the 
clock is changed by 10%. Needless to say a more nat- 
ural audio signal i£ obtained by changing the clock less 
or gradually 

(0330] In the eighth and ninth examples, the reler- 
ence lime signal is adjusted using the APTS^D Alterna- 
tively, the video decoder shown in Figuie 44 can be 
used, in which case the VPTS output Irom the video 
decoder can be used loi adjustment 
(0331] The piesent invention has been described 
by way oi specHic examples. 

(0332] The comparison between the relerence time 
signal and the VPTS or APTS. contiol oi the reproduc- 
tion time, adjustment oi the reproduction timing using a 
VPTS or APTS can be performed by a microcomputer 
which controls the entirety oi the reproduction appara- 

tUS- 



is aw>lied to optical disk ieproductton apparatuses The 
vntual tiame-based editing system according to the 
present invention is also applicable to a reproduction 

£ apparatus, relened to as the set top box. lor extending 
compiessfon signals supplied through communication 
networks 01 digital saielltte broadcasting. Even when 
the progiams are switched, the non-continuous video 
signals are connected seamlessly, whichprovides a sig- 

u niticant advantage 

INDUS! RIAL APPLICABILITY 

(0334] A basic video signal and an interpolation sig- 
75 nal aie divided into frames each having 1 GOP or moie 
and subjected to interleaving alternately to be recorded 
on the optical disk as interleave blocks. From such an 
optical disk, a high resolution synthesis reproduction 
apparatus reproduces inlormation in both oi two types 
PC oi interleave blocks alter nately arranged. When the opti- 
cal disk having a high resolution video signal is repro- 
duced by a non-progressive reproduction apparatus, 
inlormation in the interleave block oi only odd lield or 
even lield is leproduced by track jump. Thus, a com- 
25 plete two-dimensional video is obtained. Thus, compat- 
ibility is realized. 

(0335] Especially, a high resolution video signal 
arrangement inlormation file and a high resolution pic- 
ture ideniilier are recorded on the optical disk. Ac<X)rd- 

30 ingly, the location oi the high resolution video signal is 
easily determined. Therefore, two ordinary interface sig- 
nals can be made into a progressive signal. In addition, 
output oi diHeient content pictures lor the right eye and 
left eye can be avoided. 

35 (0336] According to the two-strjeam simultaneous 
reproduction synchronization system according to the 
present invention, an MPEG signal can be virtually 
edited on e 1rame-by-lrame basis, which is<X)nvention- 
ally performed only on a GOP-by-GOP -basis il-deterio- 

40 ration ot pictuie quality shouldt)e avoided. 8y recording 
reproduction control information, signals can he con- 
nected on a Irame-by-lrame basis when being repro- 
duced. Thus, virfual Ir^me^based editing can be 
realized without deterior ation in the picture quality. 

45 (0337J In the two-stream simultaneous reproduction 
synchronization system, a plurality of compression 
video signals or e plurality of compression audrosignals 
can be reproduced in synchronization with one another 
after being exterxied. 

so (0338] In a reproduction apparatus in which the ref- 
erence time signal is adjusted using an APTS<letecied 
by an audio decoder and the video output timing is con- 
trolled so that the VPTS nnatches the ^justed reference 
time signal, an audio signal and a plurality of video sig- 

55 nals are synchronized lor reproduction with no unnatu- 
ralness in the audio output. 

(0339] In a reproduction apparatus in which the 
audio output timing is controlled by changing an exten- 
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ston clock, audio and video sionals. aie synchiomzed tot 
lepTOdudion with no unnaiuialne&s in the audio output 
with no inieiiuplion oi pause in ihe audio signal. 

Claims i 

1. An opiical dt&k lepioduction appaialus lot tepio- 
ducing a signal lecoided on an opiical disk, in 
which the optical disk has. lecoided theieon. ai 
least a first video slieam lepiesenting a low Ire- 
quency component o1 the video signal and a sec- 
ond video stream representing at least a high 
fiequency component o1 the video signal, the lirst 
video stieam includes a pluiality ot tirst interleave 
units and the second video stieam includes a plu- 
lality o1 second intei leave units, each of the plurality 
oi lost interleave units includes mi GOPs (where 
ml is an integer oi 1 or greater), each oi the plural- 
ity oi second interleave units includes m2 GOPs 
(where m2 is an integer oi l or greater), the optical 
disk reproduction apparatus compiising: 

a repioduction section lor reproducing the first 
video stream and the second video stream 
recorded on the optical disk. ,vi.- 
a division section toi dividing the reproduced 
first video stream into the plurality of first intei- 
leave units and for dividing the reproduced sec- 
ond video stream into the plurality of second 
interleave units; 30 
a decoding section lor decoding the plurality of 
first interleave units to generate a first repro- 
duction signal representing the low frequency 
component of the video signal and for decoding 
the plurality of second interleave units to genei- 35 
ate a second reproduction signal representing 
at least the high frequency component of the 
video signal: 

a synthesis section tor synthesizing the first 
reproduction signal end the second reproduc- <c 
tion signal to generate the video signal; and 
an output section foi selectively outputting at 
least one of the first reproduction signal, the 
second repioduction signal, and the video sig- 
nal. <e 

2. An optical disk i eproduction apparatus according to 
claim 1, wheiein the plurality of first interleave units 
are each corresponded to first lime information 
relating to reproduction time, and the plurality of sc.. 
second interleave units are each corresponded to 
second time information i elating to reproduction 
time. 

3. An optical disk reproduction apparatus according to t£ 
claim 2. further comprising: 

a reference time signal generation section for 



geneiating a reference time signal: 
a first repioduction control section foi control- 
ling the reproduction time of the first reproduc- 
tion Signal in accordance with the difference 
between the refermce time signal and the first 
time information; 

a second reproduction control section lor con- 
1 tolling the reproduction time of the second 
reproduction signal in accordance with the dif- 
ference between the reference lime signal and 
the second lime information; and 
an adjusting section tor adjusting the reference 
time signal so that the reference time signal 
supplied to the first reproduction control section 
and the r efei ence signal supplied to the second 
lepiodudion control section represent sub- 
stantially the same time. 

4. An optical disk reproduction apparatus according to 
claim 3. wherein the adjusting section adjusts the 
reference time signal based on audio reproduction 
time information representing the time to reproduce 
an audio signal which is to be output in synchroni- 
zation with the video signal. 

5. An optical disk reproduction apparatus according to 
claim 3. wherein, the adjusting section adjusts the 
reference time signal based on at least one of first 
video reproduction time information representing 
the time to reproduce the first reproduction signal 
and second video reproduction time information 
representing the time to reproduce the second 
reproduction signal. 

6. An optical disk reproduction apparatus according to 
claim 3. wherein: 

the first reproduction control section controls 
the reproduction time of the first reproduction 
signal by skipping a frame of the first reproduc- 
tion signal or by reproducing a frame of the first 
reproduction signal in repetition; and 
the second reproduction control section con- 
trols the reproduction time of the second r^i o- 
duction signal by skipping a frame of the 
second reproduction signal or by reproducing a 
frame of the second reproduction signal in rep- 
etition. 

7. An optical disk reproduction apparatus according to 
claim 1 . wherein at least one of the first time infor- 
mation arKl the second time information includes at 
least one of a PTS. a DTS and an SCR. 

8. An optical disk reproduction apparatus according to 
claim 1 , wherein: 

the first reproduction signal corresponds to a 
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iirsi pixel number . and the second lej. toduc:icni 
signal conesponds lc a second | u>tl numljes 
which is laigei than the lust pixel numbei. 
the synthesis section includes a conveilei loi 
converting the t»st leproduction signal into c t 
conversion signal conesponding to the second 
pixel numbei, and 

the video signal is obtained by synthesizing the 
conversion signal and the second lepioduction 
signal 

9. An optical disk reproduction appaiaius according to 
claim 8. wherein the optical disk tuither has 
recorded thereon, an identrtier representing the tiisi 
pixel numbei conesponding to the lust lepioduclion if 
signal, and the converter converts the first repro- 
duction signal into the conversion signal in accoid- 
ance with the identifier. 

10. An optical disk reproduction apparatus accoiding to pc 
claim 8. wherein: 

the optical disk further has. recorded thereon, 
an identifier representing the first pixel numbei 
conesponding to the first reproduction signal. £'5 
and 

the optical disk reproduction apparatus further 
includes a rotation control section for conti oi- 
ling the rotation of the optical disk, and 
the rotation control section contr ols the i otation so 
of the optical disk in accordance with the iden* 
tiller. 

11. An optical disk reproduction apparatus according to 
claim 1 . wherein: 3£ 

the optical disk further has. recorded thereon, 
an identifier representing that the video signal 
is obtained by encoding a progressive video 
signal of 24 frames to 30 frames per second, <o 
the output section Includes a converter for con- 
verting at least one of the f irst reproduction sig- 
nal, the second reproduction signal, and the 
video signal into a frame signal, and 
the output section outputs the progressive <s 
video signal of 60 frames per second by output- 
ting the frame signal in an overlapping manner. 

12. An optical disk reproduction apparatus according to 
claim n. further comprising a buffer memory sec- bc 
tion for storing the plurality of first interleave units 
and the plurality of second interleave units, and the 
buffer memory section has a capacity which is 
equal to or greater than an amount of data of the 
GOP or GOPs included in the second interleave £f 
units. 

1 3. An optical disk reproduction apparatus according to 



claim ^2. wherejn ihc- butter memory section has a 
capacity which is t MB oi gi eater 

14. An optical disk including, lecoided thereon. ai least 
a lirst video stieam representing a low frequency 
component o1 the video signal and a second video 
stream lepresentmg at least a high fiequency com- 
ponent of the video signal, wheiem the fiisl video 
stieam includes a plurality of fust interleave units, 
the secoixl video stream includes a plurality of sec- 
ond interleave units, each of the pluiality of fust 
rntei leave units includes ml GOPs (wrfieie mi is an 
integer of i or greater), and each of the plurality o1 
second interleave units includes m2 GOPs (where 
m2 is an integei of i or greatei). 

15. An optical disk accoidmg to claim 14. wherein the 
plurality of first intei leave units and the pluiality of 
second interleave units are structuied so that repio- 
duction time of one of the plurality of first interleave 
units is substantially equal to reproduction time of 
one of the plurality of second interleave units, the 
one of the plur ality of second interleave units corre- 
sponding to the one of the plurality of first interleave 
units. 

16. An optical disk recording apparatus, comprising: 

a dividing section for dividing a video signal into 
a first video signal representing a low fre- 
quency component of the video signal and a 
second video signal representing at least a 
high frequency corrponent of the video sig- 
nal;an encoding section for generating a first 
video stream by encoding the first video signal 
and tor generating a second video stream by 
encoding the second video signal, wherein: the 
first video stream includes a plurality of first 
interleave units, the second video stream 
includes a plurality of secorxS interleave units, 
.each of the plurality of first interleave units 
includes ml GOPs (where ml is an integei of l 
or greater), and each of the plurality of second 
interleave units includes m2 GOPs (where m2 
is an integer of 1 oi greater); 
a selection output section for selectively output- 
ting the plurality of first interleave units included 
in the first video stream and the plurality of sec- 
ond interleave units included in the second 
video stream; and 

a recording section for recording the signal out- 
put from the seleaion output section on an opti- 
cal disk. 

17. An optical recording apparatus accoiding to claim 
16. wherein the division section includes a decoder 
for decoding the first video stream and a differential 
calculator for calculating a differential between the 
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video Signal and the signal output liom ihe decodei. 
and outputs the signal output tiom the ditleiential 
catculatoi as the second video signal 

18. An optical recording appaiatus according to claim 6 
17. 

wheiein the division section iuithei includes 

a iirst converter loi converting the video signal 
into a i irst conversion signal coi i espond«ng to a to 
second pixel numt^ei which is. smallei than a 
tirst pixel numbei conesponding to the video 
signal, and 

a second conveitei toi converting the signal 
output liom the decodei into a second convei- if> 
ston signal corresponding to the liist pixel 
number which is larger than the second pixel 
number corresponding to the signal output 
from the decodei . 

wherein, the division section outputs the lirst po 
conversion signal as the lirst video signal, and 
wherein the differential calculator calculates 
the dfilerential between the video signal and 
the second conversion signal. 

19. An optical disk recording apparatus according to 
claim 17. wherein the recording section lurther 
records on the optical disk an identitiei representing 
that the second video signal is output Irom the dil- 
ferential calculator. 3o 

20. An optical disk recording appaiatus according to 
claim 17, wherein the recording section lurther 
records on the optical disk an identifier representing 

the first pixel number corresponding to the video 3S 
signal. 

21. An optical disk recording apparatus according to 
claim 17. wherein the recording section further 
records on the optical disk an identitiei representing 40 
the second pixel number corresponding to the first 
video signal. 

22. An optical disk recording apparatus, comprising: 

45 

an input section for receiving an encoded first 
video stream corresponding to a first pixel 
number and an encoded second video stream 
corresponding to a second pixel number which 
is different from the first pixel number, wherein 50 
the first video stream includes a plurality of first 
interleave units, the second video stream 
includes a plurality of second interleave units, 
each of the plurality of first interleave units 
includes ml GOPs (where ml is an integer of 1 55 
or greater), and each of the plurality of second 
interleave units includes m2 GOPs (where m2 
is an integer of 1 or greater); 



a selection output section loi i^ele-aively output- 
ting the plurality o1 fust interleave units included 
in the first video slieam and the i:)luiality of sec- 
ond interleave units included in the second 
video stieam. and 

a f ecoiding section toi lecoidmg the signal out- 
put from the selection output section on an opti- 
cal disk 

23. An optical disk leproduction appaiatus foi lepio- 
ducing a signal lecoided on an optical disk, m 
which the optical disk has. lecoided theieon. at 
least a tirst video stream including a pluiaMiy of first 
GOPs and a second video stieam including a plu- 
rality of second GOPs. each of the pluiality of first 
GOPs includes a pluiality of piduies. and each of 
the plurality of second GOPs includes a pluiality of 
pictuies. the optical disk lepioduction apparatus 
comprising: 

a reproduction section for reproducing the first 
video stream and the second video stream 
recorded on the optical disk; 
a decoding section for decoding the first video 
stream and the second video stream; and 
an output section for selectively outputting the 
decoded first video stream and the decoded 
second video stream in accordance with repro- 
duction control information, 
wherein the leproduction control information 
indicates that after a first picture included in a 
final first GOP among the plurality of first GOPs 
included in the first video stream is reproduced. 
a"second picture included in a leading second 
GOP among the plurality of second GOPs 
included in the second video stieam is repro- 
duced, the second picture being different from 
a leading picture of the leading second GOP 

24. An optical disk teproduction apparatus according to 
claim 23. wherein the decoding section starts 
decoding the second video stream so that the 
decoding of the second picture has been completed 
when the reproduction of the first picture is com- 
pleted. 

25- An optical disk reproduction apparatus according to 
claim 24. wherein: 

the reproduction control information includes 
information ts1 representing a position of the 
first picture, information ts2 representing a 
position of the second picture, and information 
tsG representing a position of the leading pic- 
ture of the leading second GOP, and 
the decoding section finds a decoding start 
position tc in accordance with exptession 
t£=tsi-(ts2-tsG) . and starts decoding the sec- 
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ond video stieam based on the decoding slail 
posilicn ta 

26. An opiical disk repioduciion appaiatus accoidmg lo 
claim 24 . vjhei em 

the lepioduction coniiol mloimalion includes 
timing mtoimalion lepiejf.enimg the timing to 
stail decoding the leading second GOP so that 
lepjoduction completion time ol the lust pictuie 
matches the lepioduclion stait time ot the sec- 
ond pictuie. and 

the decoding section starts decoding the sec- 
ond video stieam based on the timing infoima- 
tion. 

27. An optical disk i epioduction appaiatus according to 
claim 23. wheiein the decoding section omits 
decoding ol a pictuie which is nol necessary for 
decoding pictures from the leading picture ot the 
leading second GOP to the second pictuie. 

28- An optical disk reproduction apparatus according to 
claim 27. wherein the picture which is not neces- 
sary is a B pictuie 

29. An opiical disk reproduction apparatus according to 
claim 23. lurther comprising a butler memory sec- 
tion tor storing the first video stream and the second 
video stream, and the butter memory section has a 
capacity which is equal to oi greater than an 
amount ot data ot 1 GOP. 

30. An optical disk reproduction apparatus according to 
claim 2o. wherein the reproduction section repro- 
duces the reproduction control information 
recorded on the optical disk. 

31. An optical disk reproduction apparatus according lo 
claim 23. wherein: 

the optical disk lurther has, recorded thereon, 
an identifier representing whether ot not the 
reproduction control inloi mation is recorded on 
the optical disk, and 

when the identifier represents that the repro- 
duction control information is recorded on the 
optical disk, the reproduction section repro- 
duces the reproduction contiol information 
recorded on the optical oisk. 

32. An optical disk i eproduction appaiatus according to 
claim 23. wheiein in a fast leproduction mode, 
vi^hen the second picture is not an I picture, the out- 
put section prohibits an I picture included in the 
lead:ng second GOF from being output. 

33. An optical disk reproduction apparatus according to 



dam whei em the output section prohibits a part 
ol the i pictuie included in the leading second GOP 
tiom being output based on I picture reproduction 
piohtbition intoimation. 

t. 

34. A I epioduction control information generation 
ai:>paialus. compiising: 

an input section for receiving a first video 
u stieam including a plurality of first GOPs and a 

second video stream inctuding a plurality of 
second GOPs; ard 

a generation section tor generating reproduc- 
tion control information which represents that 

7^ after a liist pictuie included in a final first GOP 

among the plurality of first GOPs included in 
the first video stream is reproduced, a second 
pictuie included in a leading second <?OP 
among the plurality of second GOPs included 

p{. in the second video stream is reproduced, the 

second pictuie being different from a leading 
picture of the leading second GOP. 

35- A reproduction control information generation 
P5 apparatus according to claim 34. wherein the repro- 

duction control information includes information 
lepiesenting the number of pictures from the lead- 
ing picture of the leading second GOP to the sec- 
ond picture. 

30 

36. A reproduction control information generation 
apparatus according to claim 34, wherein the repro- 
duction control information iru^ludes information 
representing the time to reproduce the leading pic- 

55 ture ol the leading second GOP and the time to 
reproduce the second picture of the leading second 
GOP 

37. A reproduction control information generation 
40 apparatus according to claim 34 . wfierein the repro- 

duction control information includes timing informa- 
tion representing the timing to start decoding the 
leading second GOP so that reproduction comple- 
tion time of the first p>icture matches the reproduc- 
<e tion start time of the secorKi picture. 

38. A reproduction control informatk)n generation 
appai atus according to claim 37. w^ierein the timing 
information represents the timing to start decoding 

50 the leading second GOP when a picture which is 
not necessary for decoding pictures from the fead- 
ing picture of the leading second GOP to the sec- 
one pictuie is not decoded. 

££ 39. A leprocuction control information generation 
apparatus according to claim 38, wherein the pic- 
ture which is not necessary is a 6 picture. 
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40. An opiical disK lecoidtng appaiatirc.. conii^i ising 

a geneialion section toi oeneiating leptoduc- 
lion conliol in1oimalic»n. and 
a lecoiding section loi lecoiding the lepioduc- 
tion conliol iniomialion on an optical disk hav- 
ing, lecoided theieon. a lust video stieam 
including a pluialily oi lust GOPs and a second 
video stieam including a pluiality o1 second 
GOPs. 

wheietn the lepioduction contiol inloimstion 
lepi esenis that atiei a tust piciui e included m a 
linal tiist GOP among the plurality ot lust GOPs 
included in the lirst video stieam is teptoduced. 
a second pictuie included in a leading second 
GOP among the pluialily ot second GOPs 
included in the second video stieam is repro- 
duced, the second pictuie being diflerent from 
a leading picture ot the leading second GOP. 

41. An optical disk recording apparatus, comprising: 

an editing section for editing a first video 
stream including a plurality o1 first GOPs and a 
second video stream including a plurality of 
second GOPs so that at least one picture 
unnecessary for reproduction is deleted: and 
a recording section for recording the edited first 
video stream and the edited second video 
stream on an optical disk, 
wherein the reproduction control information 
represents that after a first picture included in a 
final first GOP among the plurality of first GOPs 
included In the first video stieam is reproduced, 
a second picture included in a leading second 
GOP among the plurality of second GOPs 
included in the second video stream is repro- 
duced, the second picture being different from 
a leading picture ot the leading second GOP. 

42. An optical recording apparatus according to claim 

41 , wheiein the at least one picture unnecessary foi 
repioduction includes a picture, of the first video 
stream, after the first picture, and a picture, of the 
second videc stieam, before the second picture. 

43. An optical recording apparatus according to claim 

42. vk/herein the at least one picture unnecessary for 
reproduction further includes a picture v^hich is not 
necessary for decoding pictures from the leading 
picture of the leading secorKf GOP in the second 
video stream until the second pictui e. 



45. An optical lecoiding apparatus accoiding to claim 
41. wheiein the fecording section records the 
edited fust video stream and the edited second 
video stieam in continuous regions of the optical 

i disk 

46. An optical lecoiding apparatus according to claim 
41. wheiein the recording section records the 
leproduction contiol information on the optical disk. 

If. 

47. An optical lecording apparatus according to claim 
41. wheiein the recording section records the 
lepioduction control information on a medium othei 
than the optical disk. 

I* 
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44. 'A reproduction control information generation 
apparatus according to claim 43. wherein the at ££ 
least one picture unnecessary for reproduction is a 
B picture. 
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